Apr 14 18:41:50 user nova-compute[71308]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 18:41:52 user nova-compute[71308]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71308) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 18:41:52 user nova-compute[71308]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71308) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 18:41:52 user nova-compute[71308]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71308) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 18:41:52 user nova-compute[71308]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 18:41:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:41:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:41:53 user nova-compute[71308]: INFO nova.virt.driver [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 18:41:53 user nova-compute[71308]: INFO nova.compute.provider_config [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] Acquiring lock "singleton_lock" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] Acquired lock "singleton_lock" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] Releasing lock "singleton_lock" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] Full set of CONF: {{(pid=71308) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ******************************************************************************** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] Configuration options gathered from: {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ================================================================================ {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] allow_resize_to_same_host      = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] arq_binding_timeout            = 300 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] backdoor_port                  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] backdoor_socket                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] block_device_allocate_retries  = 300 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] block_device_allocate_retries_interval = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cert                           = self.pem {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute_monitors               = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] config_dir                     = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] config_drive_format            = iso9660 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] config_source                  = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] console_host                   = user {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] control_exchange               = nova {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cpu_allocation_ratio           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] daemon                         = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] debug                          = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] default_access_ip_network_name = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] default_availability_zone      = nova {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] default_ephemeral_format       = ext4 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] default_schedule_zone          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] disk_allocation_ratio          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] enable_new_services            = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] enabled_apis                   = ['osapi_compute'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] enabled_ssl_apis               = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] flat_injected                  = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] force_config_drive             = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] force_raw_images               = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] graceful_shutdown_timeout      = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] heal_instance_info_cache_interval = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] host                           = user {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] instance_build_timeout         = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] instance_delete_interval       = 300 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] instance_format                = [instance: %(uuid)s]  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] instance_name_template         = instance-%08x {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] instance_usage_audit           = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] instance_usage_audit_period    = month {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] internal_service_availability_zone = internal {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] key                            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] live_migration_retry_count     = 30 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] log_config_append              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] log_dir                        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] log_file                       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] log_options                    = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] log_rotate_interval            = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] log_rotate_interval_type       = days {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] log_rotation_type              = none {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] long_rpc_timeout               = 1800 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] max_concurrent_builds          = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] max_concurrent_live_migrations = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] max_concurrent_snapshots       = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] max_local_block_devices        = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] max_logfile_count              = 30 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] max_logfile_size_mb            = 200 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] maximum_instance_delete_attempts = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] metadata_listen                = 0.0.0.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] metadata_listen_port           = 8775 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] metadata_workers               = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] migrate_max_retries            = -1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] mkisofs_cmd                    = genisoimage {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] my_ip                          = 10.0.0.210 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] network_allocate_retries       = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] osapi_compute_listen_port      = 8774 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] osapi_compute_unique_server_name_scope =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] osapi_compute_workers          = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] password_length                = 12 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] periodic_enable                = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] periodic_fuzzy_delay           = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] pointer_model                  = ps2mouse {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] preallocate_images             = none {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] publish_errors                 = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] pybasedir                      = /opt/stack/nova {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ram_allocation_ratio           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] rate_limit_burst               = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] rate_limit_except_level        = CRITICAL {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] rate_limit_interval            = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] reboot_timeout                 = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] reclaim_instance_interval      = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] record                         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] reimage_timeout_per_gb         = 20 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] report_interval                = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] rescue_timeout                 = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] reserved_host_cpus             = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] reserved_host_disk_mb          = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] reserved_host_memory_mb        = 512 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] reserved_huge_pages            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] resize_confirm_window          = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] resize_fs_using_block_device   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] resume_guests_state_on_host_boot = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] rpc_response_timeout           = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] run_external_periodic_tasks    = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] running_deleted_instance_action = reap {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] running_deleted_instance_poll_interval = 1800 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] running_deleted_instance_timeout = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler_instance_sync_interval = 120 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_down_time              = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] servicegroup_driver            = db {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] shelved_offload_time           = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] shelved_poll_interval          = 3600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] shutdown_timeout               = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] source_is_ipv6                 = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ssl_only                       = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] state_path                     = /opt/stack/data/nova {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] sync_power_state_interval      = 600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] sync_power_state_pool_size     = 1000 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] syslog_log_facility            = LOG_USER {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] tempdir                        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] timeout_nbd                    = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] transport_url                  = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] update_resources_interval      = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] use_cow_images                 = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] use_eventlog                   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] use_journal                    = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] use_json                       = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] use_rootwrap_daemon            = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] use_stderr                     = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] use_syslog                     = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vcpu_pin_set                   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plugging_is_fatal          = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plugging_timeout           = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] virt_mkfs                      = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] volume_usage_poll_interval     = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] watch_log_file                 = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] web                            = /usr/share/spice-html5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_concurrency.disable_process_locking = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.auth_strategy              = keystone {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.compute_link_prefix        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.dhcp_domain                = novalocal {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.enable_instance_password   = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.glance_link_prefix         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.instance_list_per_project_cells = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.list_records_by_skipping_down_cells = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.local_metadata_per_cell    = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.max_limit                  = 1000 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.metadata_cache_expiration  = 15 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.neutron_default_tenant_id  = default {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.use_forwarded_for          = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.use_neutron_default_nets   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.vendordata_dynamic_targets = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.vendordata_jsonfile_path   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.backend                  = dogpile.cache.memcached {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.backend_argument         = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.config_prefix            = cache.oslo {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.dead_timeout             = 60.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.debug_cache_backend      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.enable_retry_client      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.enable_socket_keepalive  = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.enabled                  = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.expiration_time          = 600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.hashclient_retry_attempts = 2 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_dead_retry      = 300 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_password        =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_pool_maxsize    = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_sasl_enabled    = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.memcache_username        =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.proxies                  = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.retry_attempts           = 2 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.retry_delay              = 0.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.socket_keepalive_count   = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.socket_keepalive_idle    = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.socket_keepalive_interval = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.tls_allowed_ciphers      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.tls_cafile               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.tls_certfile             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.tls_enabled              = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cache.tls_keyfile              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.auth_section            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.auth_type               = password {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.cafile                  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.certfile                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.collect_timing          = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.cross_az_attach         = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.debug                   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.endpoint_template       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.http_retries            = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.insecure                = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.keyfile                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.os_region_name          = RegionOne {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.split_loggers           = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cinder.timeout                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.cpu_dedicated_set      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.cpu_shared_set         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.image_type_exclude_list = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.max_concurrent_disk_ops = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.max_disk_devices_to_attach = -1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.resource_provider_association_refresh = 300 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.shutdown_retry_interval = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] conductor.workers              = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] console.allowed_origins        = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] console.ssl_ciphers            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] console.ssl_minimum_version    = default {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] consoleauth.token_ttl          = 600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.cafile                  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.certfile                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.collect_timing          = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.connect_retries         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.connect_retry_delay     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.endpoint_override       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.insecure                = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.keyfile                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.max_version             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.min_version             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.region_name             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.service_name            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.service_type            = accelerator {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.split_loggers           = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.status_code_retries     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.status_code_retry_delay = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.timeout                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] cyborg.version                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.backend               = sqlalchemy {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.connection            = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.connection_debug      = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.connection_parameters =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.connection_recycle_time = 3600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.connection_trace      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.db_inc_retry_interval = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.db_max_retries        = 20 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.db_max_retry_interval = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.db_retry_interval     = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.max_overflow          = 50 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.max_pool_size         = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.max_retries           = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.mysql_enable_ndb      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.mysql_wsrep_sync_wait = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.pool_timeout          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.retry_interval        = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.slave_connection      = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] database.sqlite_synchronous    = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.backend           = sqlalchemy {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.connection        = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.connection_debug  = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.connection_parameters =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.connection_recycle_time = 3600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.connection_trace  = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.db_inc_retry_interval = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.db_max_retries    = 20 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.db_max_retry_interval = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.db_retry_interval = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.max_overflow      = 50 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.max_pool_size     = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.max_retries       = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.mysql_enable_ndb  = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.pool_timeout      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.retry_interval    = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.slave_connection  = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] api_database.sqlite_synchronous = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] devices.enabled_mdev_types     = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ephemeral_storage_encryption.enabled = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.api_servers             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.cafile                  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.certfile                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.collect_timing          = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.connect_retries         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.connect_retry_delay     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.debug                   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.default_trusted_certificate_ids = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.enable_certificate_validation = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.enable_rbd_download     = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.endpoint_override       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.insecure                = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.keyfile                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.max_version             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.min_version             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.num_retries             = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.rbd_ceph_conf           =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.rbd_connect_timeout     = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.rbd_pool                =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.rbd_user                =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.region_name             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.service_name            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.service_type            = image {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.split_loggers           = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.status_code_retries     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.status_code_retry_delay = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.timeout                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.verify_glance_signatures = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] glance.version                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] guestfs.debug                  = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.config_drive_cdrom      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.config_drive_inject_password = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.enable_instance_metrics_collection = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.enable_remotefx         = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.instances_path_share    =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.iscsi_initiator_list    = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.limit_cpu_features      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.power_state_check_timeframe = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.use_multipath_io        = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.volume_attach_retry_count = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.vswitch_name            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] mks.enabled                    = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] image_cache.manager_interval   = 2400 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] image_cache.precache_concurrency = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] image_cache.remove_unused_base_images = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] image_cache.subdirectory_name  = _base {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.api_max_retries         = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.api_retry_interval      = 2 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.auth_section            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.auth_type               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.cafile                  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.certfile                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.collect_timing          = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.connect_retries         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.connect_retry_delay     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.endpoint_override       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.insecure                = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.keyfile                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.max_version             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.min_version             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.partition_key           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.peer_list               = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.region_name             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.serial_console_state_timeout = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.service_name            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.service_type            = baremetal {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.split_loggers           = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.status_code_retries     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.status_code_retry_delay = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.timeout                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ironic.version                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] key_manager.fixed_key          = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.barbican_api_version  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.barbican_endpoint     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.barbican_endpoint_type = public {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.barbican_region_name  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.cafile                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.certfile              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.collect_timing        = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.insecure              = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.keyfile               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.number_of_retries     = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.retry_delay           = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.send_service_user_token = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.split_loggers         = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.timeout               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.verify_ssl            = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican.verify_ssl_path       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican_service_user.auth_section = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican_service_user.auth_type = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican_service_user.cafile   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican_service_user.certfile = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican_service_user.collect_timing = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican_service_user.insecure = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican_service_user.keyfile  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican_service_user.split_loggers = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] barbican_service_user.timeout  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.approle_role_id          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.approle_secret_id        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.cafile                   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.certfile                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.collect_timing           = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.insecure                 = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.keyfile                  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.kv_mountpoint            = secret {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.kv_version               = 2 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.namespace                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.root_token_id            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.split_loggers            = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.ssl_ca_crt_file          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.timeout                  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.use_ssl                  = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.cafile                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.certfile              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.collect_timing        = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.connect_retries       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.connect_retry_delay   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.endpoint_override     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.insecure              = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.keyfile               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.max_version           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.min_version           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.region_name           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.service_name          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.service_type          = identity {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.split_loggers         = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.status_code_retries   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.status_code_retry_delay = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.timeout               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] keystone.version               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.connection_uri         =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.cpu_mode               = custom {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: WARNING oslo_config.cfg [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.cpu_power_governor_high = performance {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.cpu_power_governor_low = powersave {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.cpu_power_management   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.device_detach_attempts = 8 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.device_detach_timeout  = 20 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.disk_cachemodes        = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.disk_prefix            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.enabled_perf_events    = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.file_backed_memory     = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.gid_maps               = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.hw_disk_discard        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.hw_machine_type        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.images_rbd_glance_store_name =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.images_rbd_pool        = rbd {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.images_type            = default {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.images_volume_group    = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.inject_key             = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.inject_partition       = -2 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.inject_password        = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.iscsi_iface            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.iser_use_multipath     = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_bandwidth = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_downtime = 500 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_inbound_addr = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_permit_post_copy = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_scheme  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_timeout_action = abort {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_tunnelled = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: WARNING oslo_config.cfg [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 18:41:53 user nova-compute[71308]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 18:41:53 user nova-compute[71308]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 18:41:53 user nova-compute[71308]: and ``live_migration_inbound_addr`` respectively.
Apr 14 18:41:53 user nova-compute[71308]: ).  Its value may be silently ignored in the future.
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.live_migration_with_native_tls = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.max_queues             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.nfs_mount_options      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.num_memory_encrypted_guests = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.num_pcie_ports         = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.pmem_namespaces        = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.quobyte_client_cfg     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rbd_secret_uuid        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rbd_user               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.remote_filesystem_transport = ssh {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rescue_image_id        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rescue_kernel_id       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rescue_ramdisk_id      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.rx_queue_size          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.smbfs_mount_options    =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.snapshot_compression   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.snapshot_image_format  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.sparse_logical_volumes = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.swtpm_enabled          = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.swtpm_group            = tss {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.swtpm_user             = tss {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.sysinfo_serial         = unique {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.tx_queue_size          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.uid_maps               = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.use_virtio_for_bridges = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.virt_type              = kvm {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.volume_clear           = zero {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.volume_clear_size      = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.volume_use_multipath   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.vzstorage_cache_path   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.vzstorage_mount_user   = stack {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.auth_section           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.auth_type              = password {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.cafile                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.certfile               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.collect_timing         = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.connect_retries        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.connect_retry_delay    = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.default_floating_pool  = public {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.endpoint_override      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.extension_sync_interval = 600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.http_retries           = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.insecure               = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.keyfile                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.max_version            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.min_version            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.ovs_bridge             = br-int {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.physnets               = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.region_name            = RegionOne {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.service_metadata_proxy = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.service_name           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.service_type           = network {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.split_loggers          = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.status_code_retries    = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.status_code_retry_delay = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.timeout                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] neutron.version                = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] notifications.bdms_in_notifications = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] notifications.default_level    = INFO {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] notifications.notification_format = unversioned {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] notifications.notify_on_state_change = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] pci.alias                      = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] pci.device_spec                = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] pci.report_in_placement        = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.auth_section         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.auth_type            = password {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.cafile               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.certfile             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.collect_timing       = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.connect_retries      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.connect_retry_delay  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.default_domain_id    = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.default_domain_name  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.domain_id            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.domain_name          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.endpoint_override    = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.insecure             = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.keyfile              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.max_version          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.min_version          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.password             = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.project_domain_id    = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.project_domain_name  = Default {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.project_id           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.project_name         = service {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.region_name          = RegionOne {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.service_name         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.service_type         = placement {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.split_loggers        = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.status_code_retries  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.status_code_retry_delay = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.system_scope         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.timeout              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.trust_id             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.user_domain_id       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.user_domain_name     = Default {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.user_id              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.username             = placement {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] placement.version              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.cores                    = 20 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.count_usage_from_placement = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.injected_file_content_bytes = 10240 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.injected_file_path_length = 255 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.injected_files           = 5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.instances                = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.key_pairs                = 100 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.metadata_items           = 128 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.ram                      = 51200 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.recheck_quota            = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.server_group_members     = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] quota.server_groups            = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] rdp.enabled                    = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.image_metadata_prefilter = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.max_attempts         = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.max_placement_results = 1000 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.query_placement_for_availability_zone = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.query_placement_for_image_type_support = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] scheduler.workers              = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.host_subset_size = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.isolated_hosts = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.isolated_images = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.pci_in_placement = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.track_instance_changes = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] metrics.required               = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] metrics.weight_multiplier      = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] metrics.weight_setting         = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] serial_console.enabled         = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] serial_console.port_range      = 10000:20000 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] serial_console.serialproxy_port = 6083 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.auth_section      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.auth_type         = password {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.cafile            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.certfile          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.collect_timing    = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.insecure          = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.keyfile           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.send_service_user_token = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.split_loggers     = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] service_user.timeout           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.agent_enabled            = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.enabled                  = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.html5proxy_port          = 6082 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.image_compression        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.jpeg_compression         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.playback_compression     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.server_listen            = 127.0.0.1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.streaming_mode           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] spice.zlib_compression         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] upgrade_levels.baseapi         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] upgrade_levels.cert            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] upgrade_levels.compute         = auto {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] upgrade_levels.conductor       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] upgrade_levels.scheduler       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vendordata_dynamic_auth.auth_section = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vendordata_dynamic_auth.auth_type = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vendordata_dynamic_auth.cafile = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vendordata_dynamic_auth.certfile = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vendordata_dynamic_auth.insecure = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vendordata_dynamic_auth.keyfile = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vendordata_dynamic_auth.timeout = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.api_retry_count         = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.ca_file                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.cache_prefix            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.cluster_name            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.connection_pool_size    = 10 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.console_delay_seconds   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.datastore_regex         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.host_ip                 = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.host_password           = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.host_port               = 443 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.host_username           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.insecure                = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.integration_bridge      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.maximum_objects         = 100 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.pbm_default_policy      = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.pbm_enabled             = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.pbm_wsdl_location       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.serial_port_proxy_uri   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.serial_port_service_uri = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.task_poll_interval      = 0.5 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.use_linked_clone        = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.vnc_keymap              = en-us {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.vnc_port                = 5900 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vmware.vnc_port_total          = 10000 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.auth_schemes               = ['none'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.enabled                    = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.novncproxy_port            = 6080 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.server_listen              = 0.0.0.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.vencrypt_ca_certs          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.vencrypt_client_cert       = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vnc.vencrypt_client_key        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.disable_rootwrap   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.enable_numa_live_migration = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.libvirt_disable_apic = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.client_socket_timeout     = 900 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.default_pool_size         = 1000 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.keep_alive                = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.max_header_line           = 16384 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.ssl_ca_file               = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.ssl_cert_file             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.ssl_key_file              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.tcp_keepidle              = 600 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] zvm.ca_file                    = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] zvm.cloud_connector_url        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] zvm.reachable_timeout          = 300 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.enforce_new_defaults = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.enforce_scope      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.policy_default_rule = default {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.policy_file        = policy.yaml {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.connection_string     = messaging:// {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.enabled               = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.es_doc_type           = notification {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.es_scroll_size        = 10000 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.es_scroll_time        = 2m {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.filter_error_trace    = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.sentinel_service_name = mymaster {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.socket_timeout        = 0.1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] profiler.trace_sqlalchemy      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] remote_debug.host              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] remote_debug.port              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.ssl      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_notifications.retry = -1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_messaging_notifications.transport_url = **** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.auth_section        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.auth_type           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.cafile              = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.certfile            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.collect_timing      = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.connect_retries     = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.connect_retry_delay = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.endpoint_id         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.endpoint_override   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.insecure            = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.keyfile             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.max_version         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.min_version         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.region_name         = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.service_name        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.service_type        = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.split_loggers       = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.status_code_retries = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.status_code_retry_delay = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.timeout             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.valid_interfaces    = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_limit.version             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_reports.file_event_handler = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] oslo_reports.log_dir           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_ovs_privileged.group  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] vif_plug_ovs_privileged.user   = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_linux_bridge.flat_interface = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_ovs.isolate_vif         = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_vif_ovs.per_port_bridge     = False {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] os_brick.lock_path             = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] privsep_osbrick.capabilities   = [21] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] privsep_osbrick.group          = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] privsep_osbrick.helper_command = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] privsep_osbrick.user           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] nova_sys_admin.group           = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] nova_sys_admin.helper_command  = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] nova_sys_admin.user            = None {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG oslo_service.service [None req-5349da90-8b39-453e-9ab4-48e9aebe04ea None None] ******************************************************************************** {{(pid=71308) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 18:41:53 user nova-compute[71308]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 18:41:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Starting native event thread {{(pid=71308) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Starting green dispatch thread {{(pid=71308) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Starting connection event dispatch thread {{(pid=71308) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Connecting to libvirt: qemu:///system {{(pid=71308) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f22768b25f0> {{(pid=71308) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 18:41:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f22768b25f0> {{(pid=71308) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 18:41:53 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Connection event '1' reason 'None'
Apr 14 18:41:53 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 18:41:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.mount [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Initialising _HostMountState generation 0 {{(pid=71308) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 18:42:00 user nova-compute[71308]: INFO nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt host capabilities <capabilities>
Apr 14 18:42:00 user nova-compute[71308]:   <host>
Apr 14 18:42:00 user nova-compute[71308]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 18:42:00 user nova-compute[71308]:     <cpu>
Apr 14 18:42:00 user nova-compute[71308]:       <arch>x86_64</arch>
Apr 14 18:42:00 user nova-compute[71308]:       <model>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <vendor>Intel</vendor>
Apr 14 18:42:00 user nova-compute[71308]:       <microcode version='1070'/>
Apr 14 18:42:00 user nova-compute[71308]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 18:42:00 user nova-compute[71308]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='ss'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='vmx'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='pcid'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='osxsave'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='hypervisor'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='arat'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='tsc_adjust'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='md-clear'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='arch-capabilities'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='invtsc'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='rsba'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 18:42:00 user nova-compute[71308]:       <pages unit='KiB' size='4'/>
Apr 14 18:42:00 user nova-compute[71308]:       <pages unit='KiB' size='2048'/>
Apr 14 18:42:00 user nova-compute[71308]:     </cpu>
Apr 14 18:42:00 user nova-compute[71308]:     <power_management>
Apr 14 18:42:00 user nova-compute[71308]:       <suspend_mem/>
Apr 14 18:42:00 user nova-compute[71308]:       <suspend_disk/>
Apr 14 18:42:00 user nova-compute[71308]:       <suspend_hybrid/>
Apr 14 18:42:00 user nova-compute[71308]:     </power_management>
Apr 14 18:42:00 user nova-compute[71308]:     <iommu support='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     <migration_features>
Apr 14 18:42:00 user nova-compute[71308]:       <live/>
Apr 14 18:42:00 user nova-compute[71308]:       <uri_transports>
Apr 14 18:42:00 user nova-compute[71308]:         <uri_transport>tcp</uri_transport>
Apr 14 18:42:00 user nova-compute[71308]:         <uri_transport>rdma</uri_transport>
Apr 14 18:42:00 user nova-compute[71308]:       </uri_transports>
Apr 14 18:42:00 user nova-compute[71308]:     </migration_features>
Apr 14 18:42:00 user nova-compute[71308]:     <topology>
Apr 14 18:42:00 user nova-compute[71308]:       <cells num='2'>
Apr 14 18:42:00 user nova-compute[71308]:         <cell id='0'>
Apr 14 18:42:00 user nova-compute[71308]:           <memory unit='KiB'>8152920</memory>
Apr 14 18:42:00 user nova-compute[71308]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 14 18:42:00 user nova-compute[71308]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 18:42:00 user nova-compute[71308]:           <distances>
Apr 14 18:42:00 user nova-compute[71308]:             <sibling id='0' value='10'/>
Apr 14 18:42:00 user nova-compute[71308]:             <sibling id='1' value='20'/>
Apr 14 18:42:00 user nova-compute[71308]:           </distances>
Apr 14 18:42:00 user nova-compute[71308]:           <cpus num='6'>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 18:42:00 user nova-compute[71308]:           </cpus>
Apr 14 18:42:00 user nova-compute[71308]:         </cell>
Apr 14 18:42:00 user nova-compute[71308]:         <cell id='1'>
Apr 14 18:42:00 user nova-compute[71308]:           <memory unit='KiB'>8255100</memory>
Apr 14 18:42:00 user nova-compute[71308]:           <pages unit='KiB' size='4'>2063775</pages>
Apr 14 18:42:00 user nova-compute[71308]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 18:42:00 user nova-compute[71308]:           <distances>
Apr 14 18:42:00 user nova-compute[71308]:             <sibling id='0' value='20'/>
Apr 14 18:42:00 user nova-compute[71308]:             <sibling id='1' value='10'/>
Apr 14 18:42:00 user nova-compute[71308]:           </distances>
Apr 14 18:42:00 user nova-compute[71308]:           <cpus num='6'>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 18:42:00 user nova-compute[71308]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 18:42:00 user nova-compute[71308]:           </cpus>
Apr 14 18:42:00 user nova-compute[71308]:         </cell>
Apr 14 18:42:00 user nova-compute[71308]:       </cells>
Apr 14 18:42:00 user nova-compute[71308]:     </topology>
Apr 14 18:42:00 user nova-compute[71308]:     <cache>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 18:42:00 user nova-compute[71308]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 18:42:00 user nova-compute[71308]:     </cache>
Apr 14 18:42:00 user nova-compute[71308]:     <secmodel>
Apr 14 18:42:00 user nova-compute[71308]:       <model>apparmor</model>
Apr 14 18:42:00 user nova-compute[71308]:       <doi>0</doi>
Apr 14 18:42:00 user nova-compute[71308]:     </secmodel>
Apr 14 18:42:00 user nova-compute[71308]:     <secmodel>
Apr 14 18:42:00 user nova-compute[71308]:       <model>dac</model>
Apr 14 18:42:00 user nova-compute[71308]:       <doi>0</doi>
Apr 14 18:42:00 user nova-compute[71308]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 18:42:00 user nova-compute[71308]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 18:42:00 user nova-compute[71308]:     </secmodel>
Apr 14 18:42:00 user nova-compute[71308]:   </host>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='alpha'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>clipper</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='armv6l'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>spitz</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>nuri</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>kzm</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sx1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>z2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>tosa</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>n810</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>n800</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>terrier</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>midway</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>microbit</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>verdex</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>highbank</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>akita</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>connex</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>collie</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='armv7l'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>spitz</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>nuri</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>kzm</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sx1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>z2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>tosa</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>n810</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>n800</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>terrier</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>midway</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>microbit</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>verdex</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>highbank</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>akita</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>connex</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>collie</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='aarch64'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>spitz</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>nuri</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>kzm</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sx1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>z2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>tosa</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>n810</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>n800</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>terrier</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>midway</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>microbit</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>verdex</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>highbank</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>akita</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>connex</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>collie</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <acpi default='on' toggle='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='cris'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='i686'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>isapc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>microvm</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='kvm'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <pae/>
Apr 14 18:42:00 user nova-compute[71308]:       <nonpae/>
Apr 14 18:42:00 user nova-compute[71308]:       <acpi default='on' toggle='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:       <apic default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='m68k'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>an5206</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>q800</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='microblaze'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='microblazeel'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='mips'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='16'>malta</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='mipsel'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='16'>malta</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='mips64'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='16'>malta</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>pica61</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>magnum</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='mips64el'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='16'>malta</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>pica61</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>magnum</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='16'>boston</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='ppc'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mac99</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>40p</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>taihu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='ppc64'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>taihu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>40p</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mac99</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='ppc64le'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>taihu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>40p</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>mac99</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='riscv32'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='8'>spike</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='8'>virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='riscv64'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='8'>spike</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='8'>virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='s390x'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='sh4'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>shix</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>r2d</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='sh4eb'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>shix</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>r2d</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='sparc'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>LX</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='sparc64'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>niagara</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='x86_64'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>64</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='1'>isapc</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>microvm</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='kvm'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <acpi default='on' toggle='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:       <apic default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='xtensa'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>sim</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>kc705</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>ml605</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>lx200</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>lx60</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]:   <guest>
Apr 14 18:42:00 user nova-compute[71308]:     <os_type>hvm</os_type>
Apr 14 18:42:00 user nova-compute[71308]:     <arch name='xtensaeb'>
Apr 14 18:42:00 user nova-compute[71308]:       <wordsize>32</wordsize>
Apr 14 18:42:00 user nova-compute[71308]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='4'>sim</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>kc705</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>ml605</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>virt</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>lx200</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>lx60</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 18:42:00 user nova-compute[71308]:       <domain type='qemu'/>
Apr 14 18:42:00 user nova-compute[71308]:     </arch>
Apr 14 18:42:00 user nova-compute[71308]:     <features>
Apr 14 18:42:00 user nova-compute[71308]:       <cpuselection/>
Apr 14 18:42:00 user nova-compute[71308]:       <deviceboot/>
Apr 14 18:42:00 user nova-compute[71308]:       <disksnapshot default='on' toggle='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     </features>
Apr 14 18:42:00 user nova-compute[71308]:   </guest>
Apr 14 18:42:00 user nova-compute[71308]: </capabilities>
Apr 14 18:42:00 user nova-compute[71308]: 
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 18:42:00 user nova-compute[71308]: <domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 18:42:00 user nova-compute[71308]:   <domain>kvm</domain>
Apr 14 18:42:00 user nova-compute[71308]:   <machine>pc-q35-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:   <arch>i686</arch>
Apr 14 18:42:00 user nova-compute[71308]:   <vcpu max='288'/>
Apr 14 18:42:00 user nova-compute[71308]:   <iothreads supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:   <os supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='firmware'/>
Apr 14 18:42:00 user nova-compute[71308]:     <loader supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>rom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pflash</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='readonly'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='secure'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </loader>
Apr 14 18:42:00 user nova-compute[71308]:   </os>
Apr 14 18:42:00 user nova-compute[71308]:   <cpu>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-passthrough' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='hostPassthroughMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='maximum' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='maximumMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-model' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <vendor>Intel</vendor>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ss'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='vmx'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pcid'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='hypervisor'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arat'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='umip'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='md-clear'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibpb'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibrs'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='erms'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='lm'/>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='custom' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>qemu64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>qemu32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>phenom</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>n270</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>kvm64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>coreduo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>core2duo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>athlon</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Westmere</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Snowridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Penryn</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G5</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G4</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G1</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Nehalem</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Rome</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Milan</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Dhyana</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cooperlake</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Conroe</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>486</model>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:   </cpu>
Apr 14 18:42:00 user nova-compute[71308]:   <memoryBacking supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='sourceType'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>file</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>anonymous</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>memfd</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:   </memoryBacking>
Apr 14 18:42:00 user nova-compute[71308]:   <devices>
Apr 14 18:42:00 user nova-compute[71308]:     <disk supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='diskDevice'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>disk</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cdrom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>floppy</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>lun</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='bus'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>fdc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sata</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </disk>
Apr 14 18:42:00 user nova-compute[71308]:     <graphics supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sdl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vnc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>spice</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egl-headless</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </graphics>
Apr 14 18:42:00 user nova-compute[71308]:     <video supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='modelType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cirrus</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vmvga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>qxl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>none</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>bochs</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ramfb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </video>
Apr 14 18:42:00 user nova-compute[71308]:     <hostdev supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='mode'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>subsystem</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='startupPolicy'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>default</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>mandatory</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>requisite</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>optional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='subsysType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pci</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='capsType'/>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='pciBackend'/>
Apr 14 18:42:00 user nova-compute[71308]:     </hostdev>
Apr 14 18:42:00 user nova-compute[71308]:     <rng supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>random</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egd</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>builtin</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </rng>
Apr 14 18:42:00 user nova-compute[71308]:     <filesystem supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='driverType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>path</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>handle</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtiofs</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </filesystem>
Apr 14 18:42:00 user nova-compute[71308]:     <tpm supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-tis</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-crb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>passthrough</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>emulator</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </tpm>
Apr 14 18:42:00 user nova-compute[71308]:   </devices>
Apr 14 18:42:00 user nova-compute[71308]:   <features>
Apr 14 18:42:00 user nova-compute[71308]:     <gic supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     <vmcoreinfo supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <genid supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backingStoreInput supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backup supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <sev supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:   </features>
Apr 14 18:42:00 user nova-compute[71308]: </domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:  {{(pid=71308) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 18:42:00 user nova-compute[71308]: <domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 18:42:00 user nova-compute[71308]:   <domain>kvm</domain>
Apr 14 18:42:00 user nova-compute[71308]:   <machine>pc-i440fx-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:   <arch>i686</arch>
Apr 14 18:42:00 user nova-compute[71308]:   <vcpu max='255'/>
Apr 14 18:42:00 user nova-compute[71308]:   <iothreads supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:   <os supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='firmware'/>
Apr 14 18:42:00 user nova-compute[71308]:     <loader supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>rom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pflash</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='readonly'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='secure'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </loader>
Apr 14 18:42:00 user nova-compute[71308]:   </os>
Apr 14 18:42:00 user nova-compute[71308]:   <cpu>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-passthrough' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='hostPassthroughMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='maximum' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='maximumMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-model' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <vendor>Intel</vendor>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ss'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='vmx'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pcid'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='hypervisor'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arat'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='umip'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='md-clear'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibpb'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibrs'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='erms'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='lm'/>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='custom' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>qemu64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>qemu32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>phenom</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>n270</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>kvm64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>coreduo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>core2duo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>athlon</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Westmere</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Snowridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Penryn</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G5</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G4</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G1</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Nehalem</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Rome</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Milan</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Dhyana</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cooperlake</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Conroe</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>486</model>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:   </cpu>
Apr 14 18:42:00 user nova-compute[71308]:   <memoryBacking supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='sourceType'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>file</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>anonymous</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>memfd</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:   </memoryBacking>
Apr 14 18:42:00 user nova-compute[71308]:   <devices>
Apr 14 18:42:00 user nova-compute[71308]:     <disk supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='diskDevice'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>disk</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cdrom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>floppy</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>lun</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='bus'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ide</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>fdc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sata</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </disk>
Apr 14 18:42:00 user nova-compute[71308]:     <graphics supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sdl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vnc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>spice</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egl-headless</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </graphics>
Apr 14 18:42:00 user nova-compute[71308]:     <video supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='modelType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cirrus</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vmvga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>qxl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>none</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>bochs</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ramfb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </video>
Apr 14 18:42:00 user nova-compute[71308]:     <hostdev supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='mode'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>subsystem</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='startupPolicy'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>default</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>mandatory</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>requisite</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>optional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='subsysType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pci</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='capsType'/>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='pciBackend'/>
Apr 14 18:42:00 user nova-compute[71308]:     </hostdev>
Apr 14 18:42:00 user nova-compute[71308]:     <rng supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>random</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egd</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>builtin</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </rng>
Apr 14 18:42:00 user nova-compute[71308]:     <filesystem supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='driverType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>path</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>handle</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtiofs</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </filesystem>
Apr 14 18:42:00 user nova-compute[71308]:     <tpm supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-tis</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-crb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>passthrough</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>emulator</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </tpm>
Apr 14 18:42:00 user nova-compute[71308]:   </devices>
Apr 14 18:42:00 user nova-compute[71308]:   <features>
Apr 14 18:42:00 user nova-compute[71308]:     <gic supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     <vmcoreinfo supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <genid supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backingStoreInput supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backup supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <sev supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:   </features>
Apr 14 18:42:00 user nova-compute[71308]: </domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:  {{(pid=71308) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 18:42:00 user nova-compute[71308]: <domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 18:42:00 user nova-compute[71308]:   <domain>kvm</domain>
Apr 14 18:42:00 user nova-compute[71308]:   <machine>pc-i440fx-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:   <arch>i686</arch>
Apr 14 18:42:00 user nova-compute[71308]:   <vcpu max='255'/>
Apr 14 18:42:00 user nova-compute[71308]:   <iothreads supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:   <os supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='firmware'/>
Apr 14 18:42:00 user nova-compute[71308]:     <loader supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>rom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pflash</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='readonly'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='secure'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </loader>
Apr 14 18:42:00 user nova-compute[71308]:   </os>
Apr 14 18:42:00 user nova-compute[71308]:   <cpu>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-passthrough' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='hostPassthroughMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='maximum' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='maximumMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-model' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <vendor>Intel</vendor>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ss'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='vmx'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pcid'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='hypervisor'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arat'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='umip'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='md-clear'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibpb'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibrs'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='erms'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='lm'/>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='custom' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>qemu64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>qemu32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>phenom</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>n270</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>kvm64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>coreduo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>core2duo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>athlon</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Westmere</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Snowridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Penryn</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G5</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G4</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G1</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Nehalem</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Rome</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Milan</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Dhyana</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cooperlake</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Conroe</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>486</model>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:   </cpu>
Apr 14 18:42:00 user nova-compute[71308]:   <memoryBacking supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='sourceType'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>file</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>anonymous</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>memfd</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:   </memoryBacking>
Apr 14 18:42:00 user nova-compute[71308]:   <devices>
Apr 14 18:42:00 user nova-compute[71308]:     <disk supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='diskDevice'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>disk</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cdrom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>floppy</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>lun</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='bus'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ide</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>fdc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sata</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </disk>
Apr 14 18:42:00 user nova-compute[71308]:     <graphics supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sdl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vnc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>spice</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egl-headless</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </graphics>
Apr 14 18:42:00 user nova-compute[71308]:     <video supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='modelType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cirrus</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vmvga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>qxl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>none</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>bochs</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ramfb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </video>
Apr 14 18:42:00 user nova-compute[71308]:     <hostdev supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='mode'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>subsystem</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='startupPolicy'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>default</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>mandatory</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>requisite</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>optional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='subsysType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pci</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='capsType'/>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='pciBackend'/>
Apr 14 18:42:00 user nova-compute[71308]:     </hostdev>
Apr 14 18:42:00 user nova-compute[71308]:     <rng supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>random</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egd</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>builtin</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </rng>
Apr 14 18:42:00 user nova-compute[71308]:     <filesystem supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='driverType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>path</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>handle</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtiofs</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </filesystem>
Apr 14 18:42:00 user nova-compute[71308]:     <tpm supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-tis</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-crb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>passthrough</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>emulator</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </tpm>
Apr 14 18:42:00 user nova-compute[71308]:   </devices>
Apr 14 18:42:00 user nova-compute[71308]:   <features>
Apr 14 18:42:00 user nova-compute[71308]:     <gic supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     <vmcoreinfo supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <genid supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backingStoreInput supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backup supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <sev supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:   </features>
Apr 14 18:42:00 user nova-compute[71308]: </domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:  {{(pid=71308) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 18:42:00 user nova-compute[71308]: <domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 18:42:00 user nova-compute[71308]:   <domain>kvm</domain>
Apr 14 18:42:00 user nova-compute[71308]:   <machine>pc-q35-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:   <arch>i686</arch>
Apr 14 18:42:00 user nova-compute[71308]:   <vcpu max='288'/>
Apr 14 18:42:00 user nova-compute[71308]:   <iothreads supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:   <os supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='firmware'/>
Apr 14 18:42:00 user nova-compute[71308]:     <loader supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>rom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pflash</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='readonly'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='secure'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </loader>
Apr 14 18:42:00 user nova-compute[71308]:   </os>
Apr 14 18:42:00 user nova-compute[71308]:   <cpu>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-passthrough' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='hostPassthroughMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='maximum' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='maximumMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-model' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <vendor>Intel</vendor>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ss'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='vmx'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pcid'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='hypervisor'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arat'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='umip'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='md-clear'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibpb'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibrs'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='erms'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='lm'/>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='custom' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>qemu64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>qemu32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>phenom</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>n270</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>kvm64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>coreduo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>core2duo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>athlon</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Westmere</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Snowridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Penryn</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G5</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G4</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G1</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Nehalem</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Rome</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Milan</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Dhyana</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cooperlake</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Conroe</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>486</model>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:   </cpu>
Apr 14 18:42:00 user nova-compute[71308]:   <memoryBacking supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='sourceType'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>file</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>anonymous</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>memfd</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:   </memoryBacking>
Apr 14 18:42:00 user nova-compute[71308]:   <devices>
Apr 14 18:42:00 user nova-compute[71308]:     <disk supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='diskDevice'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>disk</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cdrom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>floppy</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>lun</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='bus'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>fdc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sata</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </disk>
Apr 14 18:42:00 user nova-compute[71308]:     <graphics supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sdl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vnc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>spice</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egl-headless</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </graphics>
Apr 14 18:42:00 user nova-compute[71308]:     <video supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='modelType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cirrus</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vmvga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>qxl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>none</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>bochs</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ramfb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </video>
Apr 14 18:42:00 user nova-compute[71308]:     <hostdev supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='mode'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>subsystem</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='startupPolicy'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>default</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>mandatory</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>requisite</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>optional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='subsysType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pci</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='capsType'/>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='pciBackend'/>
Apr 14 18:42:00 user nova-compute[71308]:     </hostdev>
Apr 14 18:42:00 user nova-compute[71308]:     <rng supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>random</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egd</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>builtin</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </rng>
Apr 14 18:42:00 user nova-compute[71308]:     <filesystem supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='driverType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>path</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>handle</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtiofs</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </filesystem>
Apr 14 18:42:00 user nova-compute[71308]:     <tpm supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-tis</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-crb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>passthrough</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>emulator</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </tpm>
Apr 14 18:42:00 user nova-compute[71308]:   </devices>
Apr 14 18:42:00 user nova-compute[71308]:   <features>
Apr 14 18:42:00 user nova-compute[71308]:     <gic supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     <vmcoreinfo supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <genid supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backingStoreInput supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backup supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <sev supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:   </features>
Apr 14 18:42:00 user nova-compute[71308]: </domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:  {{(pid=71308) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 18:42:00 user nova-compute[71308]: <domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 18:42:00 user nova-compute[71308]:   <domain>kvm</domain>
Apr 14 18:42:00 user nova-compute[71308]:   <machine>pc-q35-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:   <arch>x86_64</arch>
Apr 14 18:42:00 user nova-compute[71308]:   <vcpu max='288'/>
Apr 14 18:42:00 user nova-compute[71308]:   <iothreads supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:   <os supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='firmware'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>efi</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:     <loader supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>rom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pflash</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='readonly'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='secure'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </loader>
Apr 14 18:42:00 user nova-compute[71308]:   </os>
Apr 14 18:42:00 user nova-compute[71308]:   <cpu>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-passthrough' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='hostPassthroughMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='maximum' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='maximumMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-model' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <vendor>Intel</vendor>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ss'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='vmx'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pcid'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='hypervisor'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arat'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='umip'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='md-clear'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='invtsc'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibpb'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibrs'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='rsba'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='erms'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='custom' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>qemu64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>qemu32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>phenom</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>n270</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>coreduo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>core2duo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>athlon</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Westmere</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Snowridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Penryn</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G5</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G4</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Opteron_G1</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Nehalem</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Rome</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Milan</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Dhyana</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cooperlake</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Conroe</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>486</model>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:   </cpu>
Apr 14 18:42:00 user nova-compute[71308]:   <memoryBacking supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='sourceType'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>file</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>anonymous</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>memfd</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:   </memoryBacking>
Apr 14 18:42:00 user nova-compute[71308]:   <devices>
Apr 14 18:42:00 user nova-compute[71308]:     <disk supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='diskDevice'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>disk</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cdrom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>floppy</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>lun</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='bus'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>fdc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sata</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </disk>
Apr 14 18:42:00 user nova-compute[71308]:     <graphics supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sdl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vnc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>spice</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egl-headless</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </graphics>
Apr 14 18:42:00 user nova-compute[71308]:     <video supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='modelType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cirrus</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vmvga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>qxl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>none</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>bochs</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ramfb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </video>
Apr 14 18:42:00 user nova-compute[71308]:     <hostdev supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='mode'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>subsystem</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='startupPolicy'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>default</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>mandatory</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>requisite</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>optional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='subsysType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pci</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='capsType'/>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='pciBackend'/>
Apr 14 18:42:00 user nova-compute[71308]:     </hostdev>
Apr 14 18:42:00 user nova-compute[71308]:     <rng supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>random</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egd</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>builtin</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </rng>
Apr 14 18:42:00 user nova-compute[71308]:     <filesystem supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='driverType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>path</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>handle</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtiofs</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </filesystem>
Apr 14 18:42:00 user nova-compute[71308]:     <tpm supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-tis</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-crb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>passthrough</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>emulator</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </tpm>
Apr 14 18:42:00 user nova-compute[71308]:   </devices>
Apr 14 18:42:00 user nova-compute[71308]:   <features>
Apr 14 18:42:00 user nova-compute[71308]:     <gic supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     <vmcoreinfo supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <genid supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backingStoreInput supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backup supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <sev supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:   </features>
Apr 14 18:42:00 user nova-compute[71308]: </domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:  {{(pid=71308) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 18:42:00 user nova-compute[71308]: <domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 18:42:00 user nova-compute[71308]:   <domain>kvm</domain>
Apr 14 18:42:00 user nova-compute[71308]:   <machine>pc-i440fx-jammy</machine>
Apr 14 18:42:00 user nova-compute[71308]:   <arch>x86_64</arch>
Apr 14 18:42:00 user nova-compute[71308]:   <vcpu max='255'/>
Apr 14 18:42:00 user nova-compute[71308]:   <iothreads supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:   <os supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='firmware'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>efi</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:     <loader supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>rom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pflash</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='readonly'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='secure'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </loader>
Apr 14 18:42:00 user nova-compute[71308]:   </os>
Apr 14 18:42:00 user nova-compute[71308]:   <cpu>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-passthrough' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='hostPassthroughMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='maximum' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='maximumMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-model' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <vendor>Intel</vendor>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ss'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='vmx'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pcid'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='hypervisor'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arat'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='umip'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='md-clear'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='invtsc'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibpb'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibrs'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='rsba'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='erms'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='custom' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>qemu64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>qemu32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>phenom</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>n270</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>coreduo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>core2duo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>athlon</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Westmere</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Snowridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Penryn</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G5</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G4</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Opteron_G1</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Nehalem</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Rome</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Milan</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Dhyana</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cooperlake</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Conroe</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>486</model>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:   </cpu>
Apr 14 18:42:00 user nova-compute[71308]:   <memoryBacking supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='sourceType'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>file</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>anonymous</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>memfd</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:   </memoryBacking>
Apr 14 18:42:00 user nova-compute[71308]:   <devices>
Apr 14 18:42:00 user nova-compute[71308]:     <disk supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='diskDevice'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>disk</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cdrom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>floppy</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>lun</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='bus'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ide</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>fdc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sata</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </disk>
Apr 14 18:42:00 user nova-compute[71308]:     <graphics supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sdl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vnc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>spice</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egl-headless</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </graphics>
Apr 14 18:42:00 user nova-compute[71308]:     <video supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='modelType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cirrus</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vmvga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>qxl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>none</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>bochs</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ramfb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </video>
Apr 14 18:42:00 user nova-compute[71308]:     <hostdev supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='mode'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>subsystem</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='startupPolicy'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>default</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>mandatory</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>requisite</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>optional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='subsysType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pci</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='capsType'/>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='pciBackend'/>
Apr 14 18:42:00 user nova-compute[71308]:     </hostdev>
Apr 14 18:42:00 user nova-compute[71308]:     <rng supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>random</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egd</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>builtin</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </rng>
Apr 14 18:42:00 user nova-compute[71308]:     <filesystem supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='driverType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>path</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>handle</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtiofs</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </filesystem>
Apr 14 18:42:00 user nova-compute[71308]:     <tpm supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-tis</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-crb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>passthrough</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>emulator</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </tpm>
Apr 14 18:42:00 user nova-compute[71308]:   </devices>
Apr 14 18:42:00 user nova-compute[71308]:   <features>
Apr 14 18:42:00 user nova-compute[71308]:     <gic supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     <vmcoreinfo supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <genid supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backingStoreInput supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backup supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <sev supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:   </features>
Apr 14 18:42:00 user nova-compute[71308]: </domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:  {{(pid=71308) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 18:42:00 user nova-compute[71308]: <domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 18:42:00 user nova-compute[71308]:   <domain>kvm</domain>
Apr 14 18:42:00 user nova-compute[71308]:   <machine>pc-i440fx-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:   <arch>x86_64</arch>
Apr 14 18:42:00 user nova-compute[71308]:   <vcpu max='255'/>
Apr 14 18:42:00 user nova-compute[71308]:   <iothreads supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:   <os supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='firmware'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>efi</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:     <loader supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>rom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pflash</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='readonly'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='secure'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </loader>
Apr 14 18:42:00 user nova-compute[71308]:   </os>
Apr 14 18:42:00 user nova-compute[71308]:   <cpu>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-passthrough' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='hostPassthroughMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='maximum' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='maximumMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-model' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <vendor>Intel</vendor>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ss'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='vmx'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pcid'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='hypervisor'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arat'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='umip'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='md-clear'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='invtsc'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibpb'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibrs'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='rsba'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='erms'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='custom' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>qemu64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>qemu32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>phenom</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>n270</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>coreduo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>core2duo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>athlon</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Westmere</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Snowridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Penryn</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G5</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G4</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Opteron_G1</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Nehalem</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Rome</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Milan</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Dhyana</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cooperlake</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Conroe</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>486</model>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:   </cpu>
Apr 14 18:42:00 user nova-compute[71308]:   <memoryBacking supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='sourceType'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>file</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>anonymous</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>memfd</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:   </memoryBacking>
Apr 14 18:42:00 user nova-compute[71308]:   <devices>
Apr 14 18:42:00 user nova-compute[71308]:     <disk supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='diskDevice'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>disk</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cdrom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>floppy</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>lun</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='bus'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ide</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>fdc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sata</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </disk>
Apr 14 18:42:00 user nova-compute[71308]:     <graphics supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sdl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vnc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>spice</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egl-headless</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </graphics>
Apr 14 18:42:00 user nova-compute[71308]:     <video supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='modelType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cirrus</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vmvga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>qxl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>none</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>bochs</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ramfb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </video>
Apr 14 18:42:00 user nova-compute[71308]:     <hostdev supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='mode'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>subsystem</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='startupPolicy'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>default</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>mandatory</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>requisite</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>optional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='subsysType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pci</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='capsType'/>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='pciBackend'/>
Apr 14 18:42:00 user nova-compute[71308]:     </hostdev>
Apr 14 18:42:00 user nova-compute[71308]:     <rng supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>random</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egd</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>builtin</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </rng>
Apr 14 18:42:00 user nova-compute[71308]:     <filesystem supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='driverType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>path</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>handle</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtiofs</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </filesystem>
Apr 14 18:42:00 user nova-compute[71308]:     <tpm supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-tis</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-crb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>passthrough</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>emulator</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </tpm>
Apr 14 18:42:00 user nova-compute[71308]:   </devices>
Apr 14 18:42:00 user nova-compute[71308]:   <features>
Apr 14 18:42:00 user nova-compute[71308]:     <gic supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     <vmcoreinfo supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <genid supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backingStoreInput supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backup supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <sev supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:   </features>
Apr 14 18:42:00 user nova-compute[71308]: </domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:  {{(pid=71308) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 18:42:00 user nova-compute[71308]: <domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 18:42:00 user nova-compute[71308]:   <domain>kvm</domain>
Apr 14 18:42:00 user nova-compute[71308]:   <machine>pc-q35-6.2</machine>
Apr 14 18:42:00 user nova-compute[71308]:   <arch>x86_64</arch>
Apr 14 18:42:00 user nova-compute[71308]:   <vcpu max='288'/>
Apr 14 18:42:00 user nova-compute[71308]:   <iothreads supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:   <os supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='firmware'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>efi</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:     <loader supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>rom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pflash</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='readonly'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='secure'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>yes</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>no</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </loader>
Apr 14 18:42:00 user nova-compute[71308]:   </os>
Apr 14 18:42:00 user nova-compute[71308]:   <cpu>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-passthrough' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='hostPassthroughMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='maximum' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='maximumMigratable'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>on</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>off</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='host-model' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <vendor>Intel</vendor>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ss'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='vmx'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pcid'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='hypervisor'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arat'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='umip'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='md-clear'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='invtsc'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibpb'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='ibrs'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-stibp'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='rsba'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='erms'/>
Apr 14 18:42:00 user nova-compute[71308]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:     <mode name='custom' supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>qemu64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>qemu32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>phenom</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>pentium</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>n270</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm64</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>kvm32</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>coreduo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>core2duo</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>athlon</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Westmere</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Snowridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Skylake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>SandyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Penryn</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G5</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G4</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G3</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Opteron_G2</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Opteron_G1</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Nehalem</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>IvyBridge</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Icelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Haswell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Rome</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-Milan</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>EPYC</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Dhyana</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cooperlake</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>Conroe</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='no'>Broadwell</model>
Apr 14 18:42:00 user nova-compute[71308]:       <model usable='yes'>486</model>
Apr 14 18:42:00 user nova-compute[71308]:     </mode>
Apr 14 18:42:00 user nova-compute[71308]:   </cpu>
Apr 14 18:42:00 user nova-compute[71308]:   <memoryBacking supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:     <enum name='sourceType'>
Apr 14 18:42:00 user nova-compute[71308]:       <value>file</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>anonymous</value>
Apr 14 18:42:00 user nova-compute[71308]:       <value>memfd</value>
Apr 14 18:42:00 user nova-compute[71308]:     </enum>
Apr 14 18:42:00 user nova-compute[71308]:   </memoryBacking>
Apr 14 18:42:00 user nova-compute[71308]:   <devices>
Apr 14 18:42:00 user nova-compute[71308]:     <disk supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='diskDevice'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>disk</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cdrom</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>floppy</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>lun</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='bus'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>fdc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sata</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </disk>
Apr 14 18:42:00 user nova-compute[71308]:     <graphics supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='type'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>sdl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vnc</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>spice</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egl-headless</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </graphics>
Apr 14 18:42:00 user nova-compute[71308]:     <video supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='modelType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>cirrus</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>vmvga</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>qxl</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>none</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>bochs</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>ramfb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </video>
Apr 14 18:42:00 user nova-compute[71308]:     <hostdev supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='mode'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>subsystem</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='startupPolicy'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>default</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>mandatory</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>requisite</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>optional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='subsysType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>usb</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>pci</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>scsi</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='capsType'/>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='pciBackend'/>
Apr 14 18:42:00 user nova-compute[71308]:     </hostdev>
Apr 14 18:42:00 user nova-compute[71308]:     <rng supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtio-non-transitional</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>random</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>egd</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>builtin</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </rng>
Apr 14 18:42:00 user nova-compute[71308]:     <filesystem supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='driverType'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>path</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>handle</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>virtiofs</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </filesystem>
Apr 14 18:42:00 user nova-compute[71308]:     <tpm supported='yes'>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='model'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-tis</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>tpm-crb</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:       <enum name='backendModel'>
Apr 14 18:42:00 user nova-compute[71308]:         <value>passthrough</value>
Apr 14 18:42:00 user nova-compute[71308]:         <value>emulator</value>
Apr 14 18:42:00 user nova-compute[71308]:       </enum>
Apr 14 18:42:00 user nova-compute[71308]:     </tpm>
Apr 14 18:42:00 user nova-compute[71308]:   </devices>
Apr 14 18:42:00 user nova-compute[71308]:   <features>
Apr 14 18:42:00 user nova-compute[71308]:     <gic supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:     <vmcoreinfo supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <genid supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backingStoreInput supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <backup supported='yes'/>
Apr 14 18:42:00 user nova-compute[71308]:     <sev supported='no'/>
Apr 14 18:42:00 user nova-compute[71308]:   </features>
Apr 14 18:42:00 user nova-compute[71308]: </domainCapabilities>
Apr 14 18:42:00 user nova-compute[71308]:  {{(pid=71308) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71308) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71308) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Checking secure boot support for host arch (x86_64) {{(pid=71308) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 18:42:00 user nova-compute[71308]: INFO nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Secure Boot support detected
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] cpu compare xml: <cpu match="exact">
Apr 14 18:42:00 user nova-compute[71308]:   <model>Nehalem</model>
Apr 14 18:42:00 user nova-compute[71308]: </cpu>
Apr 14 18:42:00 user nova-compute[71308]:  {{(pid=71308) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 18:42:00 user nova-compute[71308]: INFO nova.virt.node [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Generated node identity 6bfcc2ea-9653-419f-9d55-6c72edc19d11
Apr 14 18:42:00 user nova-compute[71308]: INFO nova.virt.node [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Wrote node identity 6bfcc2ea-9653-419f-9d55-6c72edc19d11 to /opt/stack/data/nova/compute_id
Apr 14 18:42:00 user nova-compute[71308]: WARNING nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Compute nodes ['6bfcc2ea-9653-419f-9d55-6c72edc19d11'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 18:42:00 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 18:42:00 user nova-compute[71308]: WARNING nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 18:42:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:42:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:42:01 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:42:01 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Hypervisor/Node resource view: name=user free_ram=10810MB free_disk=27.19348907470703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:42:01 user nova-compute[71308]: WARNING nova.compute.resource_tracker [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] No compute node record for user:6bfcc2ea-9653-419f-9d55-6c72edc19d11: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6bfcc2ea-9653-419f-9d55-6c72edc19d11 could not be found.
Apr 14 18:42:01 user nova-compute[71308]: INFO nova.compute.resource_tracker [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Compute node record created for user:user with uuid: 6bfcc2ea-9653-419f-9d55-6c72edc19d11
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:42:01 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [req-bfaaf445-55ff-43d7-80d2-8e8e76aecf5c] Created resource provider record via placement API for resource provider with UUID 6bfcc2ea-9653-419f-9d55-6c72edc19d11 and name user.
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71308) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 18:42:01 user nova-compute[71308]: INFO nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] kernel doesn't support AMD SEV
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Updating inventory in ProviderTree for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Libvirt baseline CPU <cpu>
Apr 14 18:42:01 user nova-compute[71308]:   <arch>x86_64</arch>
Apr 14 18:42:01 user nova-compute[71308]:   <model>Nehalem</model>
Apr 14 18:42:01 user nova-compute[71308]:   <vendor>Intel</vendor>
Apr 14 18:42:01 user nova-compute[71308]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 18:42:01 user nova-compute[71308]: </cpu>
Apr 14 18:42:01 user nova-compute[71308]:  {{(pid=71308) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Updated inventory for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Updating resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 generation from 0 to 1 during operation: update_inventory {{(pid=71308) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Updating inventory in ProviderTree for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Updating resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 generation from 1 to 2 during operation: update_traits {{(pid=71308) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.service [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Creating RPC server for service compute {{(pid=71308) start /opt/stack/nova/nova/service.py:182}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.service [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Join ServiceGroup membership for this service compute {{(pid=71308) start /opt/stack/nova/nova/service.py:199}}
Apr 14 18:42:01 user nova-compute[71308]: DEBUG nova.servicegroup.drivers.db [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71308) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 18:42:26 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:26 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:52 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:52 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:42:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:42:53 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:42:53 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:42:53 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=10180MB free_disk=27.107288360595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:42:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:43:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:43:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:43:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:43:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=10139MB free_disk=27.153812408447266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:43:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:43:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:43:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:44:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:44:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:44:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:44:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:44:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:44:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:44:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:44:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=10123MB free_disk=26.930217742919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:44:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:44:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:44:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:44:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:44:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:44:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:44:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:44:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 18:44:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 18:44:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:44:56 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:45:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:45:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:45:53 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:45:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:45:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:45:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=9426MB free_disk=26.96062469482422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:45:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:45:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:45:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:45:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:45:54 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:45:54 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:45:54 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:45:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:45:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:45:56 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:56 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:56 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:57 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:45:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:45:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 18:45:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 18:46:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:46:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:46:03 user nova-compute[71308]: INFO nova.compute.claims [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Claim successful on node user
Apr 14 18:46:03 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:46:03 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:46:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:46:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:46:04 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:46:04 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:46:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:46:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:46:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:46:04 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Creating image(s)
Apr 14 18:46:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "/opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "/opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "/opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88.part --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG nova.virt.images [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 09ac11b8-b53a-4bc5-8785-aad1f28737d3 was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88.part /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG nova.policy [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88.part /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88.converted" returned: 0 in 0.197s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.181s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:05 user nova-compute[71308]: INFO oslo.privsep.daemon [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcrx3yoxr/privsep.sock']
Apr 14 18:46:05 user sudo[80067]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcrx3yoxr/privsep.sock
Apr 14 18:46:05 user sudo[80067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 18:46:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "849b47d6-c267-420e-bb09-e43e33ad1df1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:06 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:46:07 user nova-compute[71308]: INFO nova.compute.claims [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Claim successful on node user
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:07 user sudo[80067]: pam_unix(sudo:session): session closed for user root
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:46:07 user nova-compute[71308]: INFO oslo.privsep.daemon [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Spawned new privsep daemon via rootwrap
Apr 14 18:46:07 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 18:46:07 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 18:46:07 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 18:46:07 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80080
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:46:07 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.128s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:46:07 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Creating image(s)
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "/opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "/opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "/opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk 1073741824" returned: 0 in 0.057s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.045s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:07 user nova-compute[71308]: DEBUG nova.policy [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a860138cfc74444a78dc1e456a9d67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04f259dc787d468596879969e33f2e62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk 1073741824" returned: 0 in 0.045s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Cannot resize image /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'migration_context' on Instance uuid 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Ensure instance console log exists: /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Checking if we can resize image /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Cannot resize image /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lazy-loading 'migration_context' on Instance uuid 849b47d6-c267-420e-bb09-e43e33ad1df1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Ensure instance console log exists: /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:08 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Successfully created port: 99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:46:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:09 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:46:10 user nova-compute[71308]: INFO nova.compute.claims [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Claim successful on node user
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Successfully created port: 29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:46:10 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:46:10 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Creating image(s)
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "/opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "/opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "/opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.124s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:10 user nova-compute[71308]: DEBUG nova.policy [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.121s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk 1073741824" returned: 0 in 0.046s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Cannot resize image /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'migration_context' on Instance uuid 094a4a33-569e-4137-8798-743499f1046c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Ensure instance console log exists: /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Successfully updated port: 99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquired lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received event network-changed-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Refreshing instance network info cache due to event network-changed-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Acquiring lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:46:12 user nova-compute[71308]: INFO nova.compute.claims [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Claim successful on node user
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Successfully updated port: 29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "refresh_cache-849b47d6-c267-420e-bb09-e43e33ad1df1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquired lock "refresh_cache-849b47d6-c267-420e-bb09-e43e33ad1df1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:46:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:46:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:46:13 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Creating image(s)
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received event network-changed-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Refreshing instance network info cache due to event network-changed-29b77a39-c2df-45c1-83ea-72ffe0a24460. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Acquiring lock "refresh_cache-849b47d6-c267-420e-bb09-e43e33ad1df1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.176s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.123s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk 1073741824" returned: 0 in 0.045s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.policy [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83ed7885e7774691b02c19cf08c2177f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64d84c59848f445a90eb7eab6be04253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.157s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Successfully created port: 940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updating instance_info_cache with network_info: [{"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Releasing lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Instance network_info: |[{"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Acquired lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.network.neutron [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Refreshing network info cache for port 99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Start _get_guest_xml network_info=[{"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Cannot resize image /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'migration_context' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Ensure instance console log exists: /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:13 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:13 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1351271638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1351271638',id=1,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-j8xv8pvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:04Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=89d05353-f3a2-467d-9f7f-e0da1f0c4cc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0d:88,bridge_name='br-int',has_traffic_filtering=True,id=99d9a465-1b2a-40bf-aafb-56e1a58ca1ed,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d9a465-1b') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'pci_devices' on Instance uuid 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:46:13 user nova-compute[71308]:   <uuid>89d05353-f3a2-467d-9f7f-e0da1f0c4cc6</uuid>
Apr 14 18:46:13 user nova-compute[71308]:   <name>instance-00000001</name>
Apr 14 18:46:13 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:46:13 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:46:13 user nova-compute[71308]:   <metadata>
Apr 14 18:46:13 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:46:13 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:46:13 user nova-compute[71308]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1351271638</nova:name>
Apr 14 18:46:13 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:46:13</nova:creationTime>
Apr 14 18:46:13 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:46:13 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:46:13 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:46:13 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:46:13 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:46:13 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:46:13 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:46:13 user nova-compute[71308]:       <nova:owner>
Apr 14 18:46:13 user nova-compute[71308]:         <nova:user uuid="a644b8bb9b90494ba670da8315bfe005">tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member</nova:user>
Apr 14 18:46:13 user nova-compute[71308]:         <nova:project uuid="424e732759884efa8fd126cd9a082c8a">tempest-ServerBootFromVolumeStableRescueTest-1815450365</nova:project>
Apr 14 18:46:13 user nova-compute[71308]:       </nova:owner>
Apr 14 18:46:13 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:46:13 user nova-compute[71308]:       <nova:ports>
Apr 14 18:46:13 user nova-compute[71308]:         <nova:port uuid="99d9a465-1b2a-40bf-aafb-56e1a58ca1ed">
Apr 14 18:46:13 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 18:46:13 user nova-compute[71308]:         </nova:port>
Apr 14 18:46:13 user nova-compute[71308]:       </nova:ports>
Apr 14 18:46:13 user nova-compute[71308]:     </nova:instance>
Apr 14 18:46:13 user nova-compute[71308]:   </metadata>
Apr 14 18:46:13 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:46:13 user nova-compute[71308]:     <system>
Apr 14 18:46:13 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:46:13 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:46:13 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:46:13 user nova-compute[71308]:       <entry name="serial">89d05353-f3a2-467d-9f7f-e0da1f0c4cc6</entry>
Apr 14 18:46:13 user nova-compute[71308]:       <entry name="uuid">89d05353-f3a2-467d-9f7f-e0da1f0c4cc6</entry>
Apr 14 18:46:13 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:46:13 user nova-compute[71308]:     </system>
Apr 14 18:46:13 user nova-compute[71308]:   </sysinfo>
Apr 14 18:46:13 user nova-compute[71308]:   <os>
Apr 14 18:46:13 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:46:13 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:46:13 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:46:13 user nova-compute[71308]:   </os>
Apr 14 18:46:13 user nova-compute[71308]:   <features>
Apr 14 18:46:13 user nova-compute[71308]:     <acpi/>
Apr 14 18:46:13 user nova-compute[71308]:     <apic/>
Apr 14 18:46:13 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:46:13 user nova-compute[71308]:   </features>
Apr 14 18:46:13 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:46:13 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:46:13 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:46:13 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:46:13 user nova-compute[71308]:   </clock>
Apr 14 18:46:13 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:46:13 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:46:13 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:46:13 user nova-compute[71308]:   </cpu>
Apr 14 18:46:13 user nova-compute[71308]:   <devices>
Apr 14 18:46:13 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:46:13 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:46:13 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk"/>
Apr 14 18:46:13 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:46:13 user nova-compute[71308]:     </disk>
Apr 14 18:46:13 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:46:13 user nova-compute[71308]:       <mac address="fa:16:3e:d3:0d:88"/>
Apr 14 18:46:13 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:13 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:46:13 user nova-compute[71308]:       <target dev="tap99d9a465-1b"/>
Apr 14 18:46:13 user nova-compute[71308]:     </interface>
Apr 14 18:46:13 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:46:13 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/console.log" append="off"/>
Apr 14 18:46:13 user nova-compute[71308]:     </serial>
Apr 14 18:46:13 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:46:13 user nova-compute[71308]:     <video>
Apr 14 18:46:13 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:13 user nova-compute[71308]:     </video>
Apr 14 18:46:13 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:46:13 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:46:13 user nova-compute[71308]:     </rng>
Apr 14 18:46:13 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:46:13 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:46:13 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:46:13 user nova-compute[71308]:     </memballoon>
Apr 14 18:46:13 user nova-compute[71308]:   </devices>
Apr 14 18:46:13 user nova-compute[71308]: </domain>
Apr 14 18:46:13 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1351271638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1351271638',id=1,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-j8xv8pvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:04Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=89d05353-f3a2-467d-9f7f-e0da1f0c4cc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0d:88,bridge_name='br-int',has_traffic_filtering=True,id=99d9a465-1b2a-40bf-aafb-56e1a58ca1ed,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d9a465-1b') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG os_vif [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0d:88,bridge_name='br-int',has_traffic_filtering=True,id=99d9a465-1b2a-40bf-aafb-56e1a58ca1ed,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d9a465-1b') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Created schema index Interface.name {{(pid=71308) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Created schema index Port.name {{(pid=71308) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Created schema index Bridge.name {{(pid=71308) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [POLLOUT] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:46:14 user nova-compute[71308]: INFO oslo.privsep.daemon [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpf9dv_evs/privsep.sock']
Apr 14 18:46:14 user sudo[80243]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpf9dv_evs/privsep.sock
Apr 14 18:46:14 user sudo[80243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 18:46:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Updating instance_info_cache with network_info: [{"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Releasing lock "refresh_cache-849b47d6-c267-420e-bb09-e43e33ad1df1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Instance network_info: |[{"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Acquired lock "refresh_cache-849b47d6-c267-420e-bb09-e43e33ad1df1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.network.neutron [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Refreshing network info cache for port 29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Start _get_guest_xml network_info=[{"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:46:14 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:14 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-359661015',display_name='tempest-DeleteServersTestJSON-server-359661015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-359661015',id=2,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f259dc787d468596879969e33f2e62',ramdisk_id='',reservation_id='r-f6uf2f9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1432237973',owner_user_name='tempest-DeleteServersTestJSON-1432237973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:08Z,user_data=None,user_id='3a860138cfc74444a78dc1e456a9d67f',uuid=849b47d6-c267-420e-bb09-e43e33ad1df1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Converting VIF {"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:be:20,bridge_name='br-int',has_traffic_filtering=True,id=29b77a39-c2df-45c1-83ea-72ffe0a24460,network=Network(03b497b2-e5c6-4d9a-83e2-7ddf38428b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b77a39-c2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lazy-loading 'pci_devices' on Instance uuid 849b47d6-c267-420e-bb09-e43e33ad1df1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:46:14 user nova-compute[71308]:   <uuid>849b47d6-c267-420e-bb09-e43e33ad1df1</uuid>
Apr 14 18:46:14 user nova-compute[71308]:   <name>instance-00000002</name>
Apr 14 18:46:14 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:46:14 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:46:14 user nova-compute[71308]:   <metadata>
Apr 14 18:46:14 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:46:14 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:46:14 user nova-compute[71308]:       <nova:name>tempest-DeleteServersTestJSON-server-359661015</nova:name>
Apr 14 18:46:14 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:46:14</nova:creationTime>
Apr 14 18:46:14 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:46:14 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:46:14 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:46:14 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:46:14 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:46:14 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:46:14 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:46:14 user nova-compute[71308]:       <nova:owner>
Apr 14 18:46:14 user nova-compute[71308]:         <nova:user uuid="3a860138cfc74444a78dc1e456a9d67f">tempest-DeleteServersTestJSON-1432237973-project-member</nova:user>
Apr 14 18:46:14 user nova-compute[71308]:         <nova:project uuid="04f259dc787d468596879969e33f2e62">tempest-DeleteServersTestJSON-1432237973</nova:project>
Apr 14 18:46:14 user nova-compute[71308]:       </nova:owner>
Apr 14 18:46:14 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:46:14 user nova-compute[71308]:       <nova:ports>
Apr 14 18:46:14 user nova-compute[71308]:         <nova:port uuid="29b77a39-c2df-45c1-83ea-72ffe0a24460">
Apr 14 18:46:14 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 18:46:14 user nova-compute[71308]:         </nova:port>
Apr 14 18:46:14 user nova-compute[71308]:       </nova:ports>
Apr 14 18:46:14 user nova-compute[71308]:     </nova:instance>
Apr 14 18:46:14 user nova-compute[71308]:   </metadata>
Apr 14 18:46:14 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:46:14 user nova-compute[71308]:     <system>
Apr 14 18:46:14 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:46:14 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:46:14 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:46:14 user nova-compute[71308]:       <entry name="serial">849b47d6-c267-420e-bb09-e43e33ad1df1</entry>
Apr 14 18:46:14 user nova-compute[71308]:       <entry name="uuid">849b47d6-c267-420e-bb09-e43e33ad1df1</entry>
Apr 14 18:46:14 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:46:14 user nova-compute[71308]:     </system>
Apr 14 18:46:14 user nova-compute[71308]:   </sysinfo>
Apr 14 18:46:14 user nova-compute[71308]:   <os>
Apr 14 18:46:14 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:46:14 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:46:14 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:46:14 user nova-compute[71308]:   </os>
Apr 14 18:46:14 user nova-compute[71308]:   <features>
Apr 14 18:46:14 user nova-compute[71308]:     <acpi/>
Apr 14 18:46:14 user nova-compute[71308]:     <apic/>
Apr 14 18:46:14 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:46:14 user nova-compute[71308]:   </features>
Apr 14 18:46:14 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:46:14 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:46:14 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:46:14 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:46:14 user nova-compute[71308]:   </clock>
Apr 14 18:46:14 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:46:14 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:46:14 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:46:14 user nova-compute[71308]:   </cpu>
Apr 14 18:46:14 user nova-compute[71308]:   <devices>
Apr 14 18:46:14 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:46:14 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:46:14 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk"/>
Apr 14 18:46:14 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:46:14 user nova-compute[71308]:     </disk>
Apr 14 18:46:14 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:46:14 user nova-compute[71308]:       <mac address="fa:16:3e:0d:be:20"/>
Apr 14 18:46:14 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:14 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:46:14 user nova-compute[71308]:       <target dev="tap29b77a39-c2"/>
Apr 14 18:46:14 user nova-compute[71308]:     </interface>
Apr 14 18:46:14 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:46:14 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/console.log" append="off"/>
Apr 14 18:46:14 user nova-compute[71308]:     </serial>
Apr 14 18:46:14 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:46:14 user nova-compute[71308]:     <video>
Apr 14 18:46:14 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:14 user nova-compute[71308]:     </video>
Apr 14 18:46:14 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:46:14 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:46:14 user nova-compute[71308]:     </rng>
Apr 14 18:46:14 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:46:14 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:46:14 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:46:14 user nova-compute[71308]:     </memballoon>
Apr 14 18:46:14 user nova-compute[71308]:   </devices>
Apr 14 18:46:14 user nova-compute[71308]: </domain>
Apr 14 18:46:14 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-359661015',display_name='tempest-DeleteServersTestJSON-server-359661015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-359661015',id=2,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04f259dc787d468596879969e33f2e62',ramdisk_id='',reservation_id='r-f6uf2f9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1432237973',owner_user_name='tempest-DeleteServersTestJSON-1432237973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:08Z,user_data=None,user_id='3a860138cfc74444a78dc1e456a9d67f',uuid=849b47d6-c267-420e-bb09-e43e33ad1df1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Converting VIF {"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:be:20,bridge_name='br-int',has_traffic_filtering=True,id=29b77a39-c2df-45c1-83ea-72ffe0a24460,network=Network(03b497b2-e5c6-4d9a-83e2-7ddf38428b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b77a39-c2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG os_vif [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:be:20,bridge_name='br-int',has_traffic_filtering=True,id=29b77a39-c2df-45c1-83ea-72ffe0a24460,network=Network(03b497b2-e5c6-4d9a-83e2-7ddf38428b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b77a39-c2') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:46:14 user nova-compute[71308]: INFO nova.compute.claims [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Claim successful on node user
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:46:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.network.neutron [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updated VIF entry in instance network info cache for port 99d9a465-1b2a-40bf-aafb-56e1a58ca1ed. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.network.neutron [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updating instance_info_cache with network_info: [{"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-75144df8-7b77-4877-b2c6-e1d2358c00ae req-476551ef-03eb-4535-80e7-0be15253083c service nova] Releasing lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:46:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Creating image(s)
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.128s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:15 user sudo[80243]: pam_unix(sudo:session): session closed for user root
Apr 14 18:46:15 user nova-compute[71308]: INFO oslo.privsep.daemon [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Spawned new privsep daemon via rootwrap
Apr 14 18:46:15 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 18:46:15 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 18:46:15 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 18:46:15 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80265
Apr 14 18:46:15 user nova-compute[71308]: WARNING oslo_privsep.priv_context [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] privsep daemon already running
Apr 14 18:46:15 user nova-compute[71308]: DEBUG nova.policy [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:46:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.network.neutron [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Updated VIF entry in instance network info cache for port 29b77a39-c2df-45c1-83ea-72ffe0a24460. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.network.neutron [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Updating instance_info_cache with network_info: [{"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk 1073741824" returned: 0 in 0.071s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-944f87d4-7b39-4d43-bcb7-de91d3c37277 req-50775ddc-0329-4907-9c38-b0aa20cdf4c5 service nova] Releasing lock "refresh_cache-849b47d6-c267-420e-bb09-e43e33ad1df1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Successfully updated port: 940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquired lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Successfully created port: 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received event network-changed-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Refreshing instance network info cache due to event network-changed-940c6edd-6fc7-4e88-92b4-38a62e88f2ab. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] Acquiring lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Cannot resize image /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.objects.instance [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'migration_context' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Ensure instance console log exists: /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29b77a39-c2, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29b77a39-c2, col_values=(('external_ids', {'iface-id': '29b77a39-c2df-45c1-83ea-72ffe0a24460', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:be:20', 'vm-uuid': '849b47d6-c267-420e-bb09-e43e33ad1df1'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:16 user nova-compute[71308]: INFO os_vif [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:be:20,bridge_name='br-int',has_traffic_filtering=True,id=29b77a39-c2df-45c1-83ea-72ffe0a24460,network=Network(03b497b2-e5c6-4d9a-83e2-7ddf38428b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b77a39-c2')
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99d9a465-1b, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99d9a465-1b, col_values=(('external_ids', {'iface-id': '99d9a465-1b2a-40bf-aafb-56e1a58ca1ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:0d:88', 'vm-uuid': '89d05353-f3a2-467d-9f7f-e0da1f0c4cc6'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:16 user nova-compute[71308]: INFO os_vif [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0d:88,bridge_name='br-int',has_traffic_filtering=True,id=99d9a465-1b2a-40bf-aafb-56e1a58ca1ed,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d9a465-1b')
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No VIF found with MAC fa:16:3e:d3:0d:88, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] No VIF found with MAC fa:16:3e:0d:be:20, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Updating instance_info_cache with network_info: [{"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Releasing lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Instance network_info: |[{"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] Acquired lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.network.neutron [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Refreshing network info cache for port 940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Start _get_guest_xml network_info=[{"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:46:17 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:17 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-215795382',display_name='tempest-AttachVolumeNegativeTest-server-215795382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-215795382',id=3,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcnNYGBRk0T6UxqrAha7Z7Vc1FFjiy6Mjj7iMKuh2Pb5hXRv1c3o+L8zfJZoZltWQ/PaAHBztxQ47uQg4w2vJU1ykAEMJkmmLwbyLyAWrDxacAv1mprhptr2nQm4buAkw==',key_name='tempest-keypair-275380641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-4w5nbibl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=094a4a33-569e-4137-8798-743499f1046c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=940c6edd-6fc7-4e88-92b4-38a62e88f2ab,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940c6edd-6f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'pci_devices' on Instance uuid 094a4a33-569e-4137-8798-743499f1046c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:46:17 user nova-compute[71308]:   <uuid>094a4a33-569e-4137-8798-743499f1046c</uuid>
Apr 14 18:46:17 user nova-compute[71308]:   <name>instance-00000003</name>
Apr 14 18:46:17 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:46:17 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:46:17 user nova-compute[71308]:   <metadata>
Apr 14 18:46:17 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:46:17 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:46:17 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeNegativeTest-server-215795382</nova:name>
Apr 14 18:46:17 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:46:17</nova:creationTime>
Apr 14 18:46:17 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:46:17 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:46:17 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:46:17 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:46:17 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:46:17 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:46:17 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:46:17 user nova-compute[71308]:       <nova:owner>
Apr 14 18:46:17 user nova-compute[71308]:         <nova:user uuid="8d53edaffb8f4038abd366d7942c6bc7">tempest-AttachVolumeNegativeTest-1648028886-project-member</nova:user>
Apr 14 18:46:17 user nova-compute[71308]:         <nova:project uuid="e34cdebcd7154988a957deae140e8eab">tempest-AttachVolumeNegativeTest-1648028886</nova:project>
Apr 14 18:46:17 user nova-compute[71308]:       </nova:owner>
Apr 14 18:46:17 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:46:17 user nova-compute[71308]:       <nova:ports>
Apr 14 18:46:17 user nova-compute[71308]:         <nova:port uuid="940c6edd-6fc7-4e88-92b4-38a62e88f2ab">
Apr 14 18:46:17 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 18:46:17 user nova-compute[71308]:         </nova:port>
Apr 14 18:46:17 user nova-compute[71308]:       </nova:ports>
Apr 14 18:46:17 user nova-compute[71308]:     </nova:instance>
Apr 14 18:46:17 user nova-compute[71308]:   </metadata>
Apr 14 18:46:17 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:46:17 user nova-compute[71308]:     <system>
Apr 14 18:46:17 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:46:17 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:46:17 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:46:17 user nova-compute[71308]:       <entry name="serial">094a4a33-569e-4137-8798-743499f1046c</entry>
Apr 14 18:46:17 user nova-compute[71308]:       <entry name="uuid">094a4a33-569e-4137-8798-743499f1046c</entry>
Apr 14 18:46:17 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:46:17 user nova-compute[71308]:     </system>
Apr 14 18:46:17 user nova-compute[71308]:   </sysinfo>
Apr 14 18:46:17 user nova-compute[71308]:   <os>
Apr 14 18:46:17 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:46:17 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:46:17 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:46:17 user nova-compute[71308]:   </os>
Apr 14 18:46:17 user nova-compute[71308]:   <features>
Apr 14 18:46:17 user nova-compute[71308]:     <acpi/>
Apr 14 18:46:17 user nova-compute[71308]:     <apic/>
Apr 14 18:46:17 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:46:17 user nova-compute[71308]:   </features>
Apr 14 18:46:17 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:46:17 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:46:17 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:46:17 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:46:17 user nova-compute[71308]:   </clock>
Apr 14 18:46:17 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:46:17 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:46:17 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:46:17 user nova-compute[71308]:   </cpu>
Apr 14 18:46:17 user nova-compute[71308]:   <devices>
Apr 14 18:46:17 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:46:17 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:46:17 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk"/>
Apr 14 18:46:17 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:46:17 user nova-compute[71308]:     </disk>
Apr 14 18:46:17 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:46:17 user nova-compute[71308]:       <mac address="fa:16:3e:84:f7:b1"/>
Apr 14 18:46:17 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:17 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:46:17 user nova-compute[71308]:       <target dev="tap940c6edd-6f"/>
Apr 14 18:46:17 user nova-compute[71308]:     </interface>
Apr 14 18:46:17 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:46:17 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/console.log" append="off"/>
Apr 14 18:46:17 user nova-compute[71308]:     </serial>
Apr 14 18:46:17 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:46:17 user nova-compute[71308]:     <video>
Apr 14 18:46:17 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:17 user nova-compute[71308]:     </video>
Apr 14 18:46:17 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:46:17 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:46:17 user nova-compute[71308]:     </rng>
Apr 14 18:46:17 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:46:17 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:46:17 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:46:17 user nova-compute[71308]:     </memballoon>
Apr 14 18:46:17 user nova-compute[71308]:   </devices>
Apr 14 18:46:17 user nova-compute[71308]: </domain>
Apr 14 18:46:17 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-215795382',display_name='tempest-AttachVolumeNegativeTest-server-215795382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-215795382',id=3,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcnNYGBRk0T6UxqrAha7Z7Vc1FFjiy6Mjj7iMKuh2Pb5hXRv1c3o+L8zfJZoZltWQ/PaAHBztxQ47uQg4w2vJU1ykAEMJkmmLwbyLyAWrDxacAv1mprhptr2nQm4buAkw==',key_name='tempest-keypair-275380641',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-4w5nbibl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=094a4a33-569e-4137-8798-743499f1046c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=940c6edd-6fc7-4e88-92b4-38a62e88f2ab,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940c6edd-6f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG os_vif [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=940c6edd-6fc7-4e88-92b4-38a62e88f2ab,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940c6edd-6f') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap940c6edd-6f, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap940c6edd-6f, col_values=(('external_ids', {'iface-id': '940c6edd-6fc7-4e88-92b4-38a62e88f2ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:f7:b1', 'vm-uuid': '094a4a33-569e-4137-8798-743499f1046c'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:17 user nova-compute[71308]: INFO os_vif [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=940c6edd-6fc7-4e88-92b4-38a62e88f2ab,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940c6edd-6f')
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No VIF found with MAC fa:16:3e:84:f7:b1, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:46:18 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Successfully updated port: 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:46:18 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Successfully created port: 2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:46:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquired lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:18 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:46:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-changed-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Refreshing instance network info cache due to event network-changed-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:46:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Acquiring lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG nova.network.neutron [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Updated VIF entry in instance network info cache for port 940c6edd-6fc7-4e88-92b4-38a62e88f2ab. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:46:19 user nova-compute[71308]: DEBUG nova.network.neutron [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Updating instance_info_cache with network_info: [{"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c939b209-2578-44ce-821f-bc3b4c93e42c req-bb684c44-cb97-45f2-87f3-d96987eaa1e8 service nova] Releasing lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received event network-vif-plugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] Acquiring lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] No waiting events found dispatching network-vif-plugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:20 user nova-compute[71308]: WARNING nova.compute.manager [req-4444128e-b347-4ee1-a74e-e68da3540a84 req-9519fd0d-584c-4109-aa19-15faa70e03cf service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received unexpected event network-vif-plugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance with vm_state building and task_state spawning.
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating instance_info_cache with network_info: [{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Releasing lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Instance network_info: |[{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Acquired lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.network.neutron [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Refreshing network info cache for port 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Start _get_guest_xml network_info=[{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:46:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1341803639',display_name='tempest-ServerStableDeviceRescueTest-server-1341803639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1341803639',id=4,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGjNz78QsEg7GY5Q/x5R0+fXhMd4+j5aNId0d7KMgDy/nQskSviXpD3wS5mHEhEb7jjb1W7n7QHncfc1ds0/3pZ7+zPW5nX4bCBjYud5GgMoBiur+7hIWtHB4iei5HABw==',key_name='tempest-keypair-1040648644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d84c59848f445a90eb7eab6be04253',ramdisk_id='',reservation_id='r-2zoj7i2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-728638156',owner_user_name='tempest-ServerStableDeviceRescueTest-728638156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ed7885e7774691b02c19cf08c2177f',uuid=8e55c721-9fad-4478-9e74-e87d0c95bc3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Converting VIF {"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:d7:82,bridge_name='br-int',has_traffic_filtering=True,id=66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3,network=Network(703a8d85-ee89-4c7b-addb-bc6424312027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba5ca6-da') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:46:20 user nova-compute[71308]:   <uuid>8e55c721-9fad-4478-9e74-e87d0c95bc3c</uuid>
Apr 14 18:46:20 user nova-compute[71308]:   <name>instance-00000004</name>
Apr 14 18:46:20 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:46:20 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:46:20 user nova-compute[71308]:   <metadata>
Apr 14 18:46:20 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:46:20 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:46:20 user nova-compute[71308]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1341803639</nova:name>
Apr 14 18:46:20 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:46:20</nova:creationTime>
Apr 14 18:46:20 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:46:20 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:46:20 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:46:20 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:46:20 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:46:20 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:46:20 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:46:20 user nova-compute[71308]:       <nova:owner>
Apr 14 18:46:20 user nova-compute[71308]:         <nova:user uuid="83ed7885e7774691b02c19cf08c2177f">tempest-ServerStableDeviceRescueTest-728638156-project-member</nova:user>
Apr 14 18:46:20 user nova-compute[71308]:         <nova:project uuid="64d84c59848f445a90eb7eab6be04253">tempest-ServerStableDeviceRescueTest-728638156</nova:project>
Apr 14 18:46:20 user nova-compute[71308]:       </nova:owner>
Apr 14 18:46:20 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:46:20 user nova-compute[71308]:       <nova:ports>
Apr 14 18:46:20 user nova-compute[71308]:         <nova:port uuid="66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3">
Apr 14 18:46:20 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 18:46:20 user nova-compute[71308]:         </nova:port>
Apr 14 18:46:20 user nova-compute[71308]:       </nova:ports>
Apr 14 18:46:20 user nova-compute[71308]:     </nova:instance>
Apr 14 18:46:20 user nova-compute[71308]:   </metadata>
Apr 14 18:46:20 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:46:20 user nova-compute[71308]:     <system>
Apr 14 18:46:20 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:46:20 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:46:20 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:46:20 user nova-compute[71308]:       <entry name="serial">8e55c721-9fad-4478-9e74-e87d0c95bc3c</entry>
Apr 14 18:46:20 user nova-compute[71308]:       <entry name="uuid">8e55c721-9fad-4478-9e74-e87d0c95bc3c</entry>
Apr 14 18:46:20 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:46:20 user nova-compute[71308]:     </system>
Apr 14 18:46:20 user nova-compute[71308]:   </sysinfo>
Apr 14 18:46:20 user nova-compute[71308]:   <os>
Apr 14 18:46:20 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:46:20 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:46:20 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:46:20 user nova-compute[71308]:   </os>
Apr 14 18:46:20 user nova-compute[71308]:   <features>
Apr 14 18:46:20 user nova-compute[71308]:     <acpi/>
Apr 14 18:46:20 user nova-compute[71308]:     <apic/>
Apr 14 18:46:20 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:46:20 user nova-compute[71308]:   </features>
Apr 14 18:46:20 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:46:20 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:46:20 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:46:20 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:46:20 user nova-compute[71308]:   </clock>
Apr 14 18:46:20 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:46:20 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:46:20 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:46:20 user nova-compute[71308]:   </cpu>
Apr 14 18:46:20 user nova-compute[71308]:   <devices>
Apr 14 18:46:20 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:46:20 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:46:20 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk"/>
Apr 14 18:46:20 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:46:20 user nova-compute[71308]:     </disk>
Apr 14 18:46:20 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:46:20 user nova-compute[71308]:       <mac address="fa:16:3e:24:d7:82"/>
Apr 14 18:46:20 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:20 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:46:20 user nova-compute[71308]:       <target dev="tap66ba5ca6-da"/>
Apr 14 18:46:20 user nova-compute[71308]:     </interface>
Apr 14 18:46:20 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:46:20 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/console.log" append="off"/>
Apr 14 18:46:20 user nova-compute[71308]:     </serial>
Apr 14 18:46:20 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:46:20 user nova-compute[71308]:     <video>
Apr 14 18:46:20 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:20 user nova-compute[71308]:     </video>
Apr 14 18:46:20 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:46:20 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:46:20 user nova-compute[71308]:     </rng>
Apr 14 18:46:20 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:46:20 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:46:20 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:46:20 user nova-compute[71308]:     </memballoon>
Apr 14 18:46:20 user nova-compute[71308]:   </devices>
Apr 14 18:46:20 user nova-compute[71308]: </domain>
Apr 14 18:46:20 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1341803639',display_name='tempest-ServerStableDeviceRescueTest-server-1341803639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1341803639',id=4,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGjNz78QsEg7GY5Q/x5R0+fXhMd4+j5aNId0d7KMgDy/nQskSviXpD3wS5mHEhEb7jjb1W7n7QHncfc1ds0/3pZ7+zPW5nX4bCBjYud5GgMoBiur+7hIWtHB4iei5HABw==',key_name='tempest-keypair-1040648644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64d84c59848f445a90eb7eab6be04253',ramdisk_id='',reservation_id='r-2zoj7i2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-728638156',owner_user_name='tempest-ServerStableDeviceRescueTest-728638156-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ed7885e7774691b02c19cf08c2177f',uuid=8e55c721-9fad-4478-9e74-e87d0c95bc3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Converting VIF {"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:d7:82,bridge_name='br-int',has_traffic_filtering=True,id=66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3,network=Network(703a8d85-ee89-4c7b-addb-bc6424312027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba5ca6-da') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG os_vif [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:d7:82,bridge_name='br-int',has_traffic_filtering=True,id=66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3,network=Network(703a8d85-ee89-4c7b-addb-bc6424312027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba5ca6-da') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66ba5ca6-da, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66ba5ca6-da, col_values=(('external_ids', {'iface-id': '66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:d7:82', 'vm-uuid': '8e55c721-9fad-4478-9e74-e87d0c95bc3c'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: INFO os_vif [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:d7:82,bridge_name='br-int',has_traffic_filtering=True,id=66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3,network=Network(703a8d85-ee89-4c7b-addb-bc6424312027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba5ca6-da')
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] No VIF found with MAC fa:16:3e:24:d7:82, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received event network-vif-plugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] Acquiring lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] No waiting events found dispatching network-vif-plugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:21 user nova-compute[71308]: WARNING nova.compute.manager [req-4163cf1f-a4c6-4088-bd44-ec83d9450a55 req-728d0eb1-2088-44ba-939e-544311bf2f88 service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received unexpected event network-vif-plugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance with vm_state building and task_state spawning.
Apr 14 18:46:21 user nova-compute[71308]: DEBUG nova.network.neutron [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updated VIF entry in instance network info cache for port 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:46:21 user nova-compute[71308]: DEBUG nova.network.neutron [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating instance_info_cache with network_info: [{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d72c3cbf-2ef7-4699-a499-4c2fa5d349c1 req-a35b1249-171c-4192-b8b1-4e7bf394aee4 service nova] Releasing lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received event network-vif-plugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] Acquiring lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] No waiting events found dispatching network-vif-plugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:22 user nova-compute[71308]: WARNING nova.compute.manager [req-988b794e-77b3-4ac3-87ce-7891ec65736e req-6ec91c12-14eb-45e2-9524-fcbb39ea6206 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received unexpected event network-vif-plugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance with vm_state building and task_state spawning.
Apr 14 18:46:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received event network-vif-plugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] Lock "094a4a33-569e-4137-8798-743499f1046c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] Lock "094a4a33-569e-4137-8798-743499f1046c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] No waiting events found dispatching network-vif-plugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:22 user nova-compute[71308]: WARNING nova.compute.manager [req-cfe723ec-408c-490c-a9f9-4656e867ffc6 req-4e3ecd73-cfbd-441e-9274-949b41abfa1b service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received unexpected event network-vif-plugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance with vm_state building and task_state spawning.
Apr 14 18:46:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Successfully updated port: 2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497983.281984, 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] VM Resumed (Lifecycle Event)
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Instance spawned successfully.
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received event network-vif-plugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] Acquiring lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] No waiting events found dispatching network-vif-plugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:23 user nova-compute[71308]: WARNING nova.compute.manager [req-c76b9032-29f5-4392-ae10-145b1943ce2b req-5466c23b-2d75-4ca5-9c3a-10ec4567bc00 service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received unexpected event network-vif-plugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance with vm_state building and task_state spawning.
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497983.2834368, 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] VM Started (Lifecycle Event)
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Took 19.13 seconds to spawn the instance on the hypervisor.
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497983.5968394, 849b47d6-c267-420e-bb09-e43e33ad1df1 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] VM Resumed (Lifecycle Event)
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Instance spawned successfully.
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Took 20.34 seconds to build instance.
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497983.5993707, 849b47d6-c267-420e-bb09-e43e33ad1df1 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] VM Started (Lifecycle Event)
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f045f196-ee9a-4821-914d-4e83fbc9cc90 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.561s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Took 16.13 seconds to spawn the instance on the hypervisor.
Apr 14 18:46:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Took 16.99 seconds to build instance.
Apr 14 18:46:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d9633a7b-be0e-425b-93f0-aa6f03a19853 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.139s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:24 user nova-compute[71308]: WARNING nova.compute.manager [req-f3a7c44a-86eb-4c55-ade7-9ec8fd4ce6c4 req-7cfb45c8-2d29-42a9-96c2-6968ac4dcdb5 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state building and task_state spawning.
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-changed-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Refreshing instance network info cache due to event network-changed-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Acquiring lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497984.3994389, 094a4a33-569e-4137-8798-743499f1046c => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:24 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] VM Resumed (Lifecycle Event)
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:46:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 094a4a33-569e-4137-8798-743499f1046c] Instance spawned successfully.
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:24 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497984.4075112, 094a4a33-569e-4137-8798-743499f1046c => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:24 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] VM Started (Lifecycle Event)
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:24 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:24 user nova-compute[71308]: INFO nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Took 13.88 seconds to spawn the instance on the hypervisor.
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance network_info: |[{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Acquired lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Refreshing network info cache for port 2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Start _get_guest_xml network_info=[{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:24 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:24 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1477481393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.objects.instance [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'pci_devices' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:24 user nova-compute[71308]: INFO nova.compute.manager [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Took 14.89 seconds to build instance.
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:46:24 user nova-compute[71308]:   <uuid>aa09363f-435d-4fa8-9f11-db0c3f4e08be</uuid>
Apr 14 18:46:24 user nova-compute[71308]:   <name>instance-00000005</name>
Apr 14 18:46:24 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:46:24 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:46:24 user nova-compute[71308]:   <metadata>
Apr 14 18:46:24 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:46:24 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:46:24 user nova-compute[71308]:       <nova:name>tempest-ServerActionsTestJSON-server-1477481393</nova:name>
Apr 14 18:46:24 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:46:24</nova:creationTime>
Apr 14 18:46:24 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:46:24 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:46:24 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:46:24 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:46:24 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:46:24 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:46:24 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:46:24 user nova-compute[71308]:       <nova:owner>
Apr 14 18:46:24 user nova-compute[71308]:         <nova:user uuid="55fa4abe2fdd48cb91f39bf8156a7793">tempest-ServerActionsTestJSON-2112054326-project-member</nova:user>
Apr 14 18:46:24 user nova-compute[71308]:         <nova:project uuid="f028a79640b848228dc6e654a0eef49b">tempest-ServerActionsTestJSON-2112054326</nova:project>
Apr 14 18:46:24 user nova-compute[71308]:       </nova:owner>
Apr 14 18:46:24 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:46:24 user nova-compute[71308]:       <nova:ports>
Apr 14 18:46:24 user nova-compute[71308]:         <nova:port uuid="2afe22e1-0044-47e2-ba5f-e1d9fd6d0620">
Apr 14 18:46:24 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 18:46:24 user nova-compute[71308]:         </nova:port>
Apr 14 18:46:24 user nova-compute[71308]:       </nova:ports>
Apr 14 18:46:24 user nova-compute[71308]:     </nova:instance>
Apr 14 18:46:24 user nova-compute[71308]:   </metadata>
Apr 14 18:46:24 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:46:24 user nova-compute[71308]:     <system>
Apr 14 18:46:24 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:46:24 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:46:24 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:46:24 user nova-compute[71308]:       <entry name="serial">aa09363f-435d-4fa8-9f11-db0c3f4e08be</entry>
Apr 14 18:46:24 user nova-compute[71308]:       <entry name="uuid">aa09363f-435d-4fa8-9f11-db0c3f4e08be</entry>
Apr 14 18:46:24 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:46:24 user nova-compute[71308]:     </system>
Apr 14 18:46:24 user nova-compute[71308]:   </sysinfo>
Apr 14 18:46:24 user nova-compute[71308]:   <os>
Apr 14 18:46:24 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:46:24 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:46:24 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:46:24 user nova-compute[71308]:   </os>
Apr 14 18:46:24 user nova-compute[71308]:   <features>
Apr 14 18:46:24 user nova-compute[71308]:     <acpi/>
Apr 14 18:46:24 user nova-compute[71308]:     <apic/>
Apr 14 18:46:24 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:46:24 user nova-compute[71308]:   </features>
Apr 14 18:46:24 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:46:24 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:46:24 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:46:24 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:46:24 user nova-compute[71308]:   </clock>
Apr 14 18:46:24 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:46:24 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:46:24 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:46:24 user nova-compute[71308]:   </cpu>
Apr 14 18:46:24 user nova-compute[71308]:   <devices>
Apr 14 18:46:24 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:46:24 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:46:24 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk"/>
Apr 14 18:46:24 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:46:24 user nova-compute[71308]:     </disk>
Apr 14 18:46:24 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:46:24 user nova-compute[71308]:       <mac address="fa:16:3e:11:69:69"/>
Apr 14 18:46:24 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:24 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:46:24 user nova-compute[71308]:       <target dev="tap2afe22e1-00"/>
Apr 14 18:46:24 user nova-compute[71308]:     </interface>
Apr 14 18:46:24 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:46:24 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/console.log" append="off"/>
Apr 14 18:46:24 user nova-compute[71308]:     </serial>
Apr 14 18:46:24 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:46:24 user nova-compute[71308]:     <video>
Apr 14 18:46:24 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:24 user nova-compute[71308]:     </video>
Apr 14 18:46:24 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:46:24 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:46:24 user nova-compute[71308]:     </rng>
Apr 14 18:46:24 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:46:24 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:46:24 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:46:24 user nova-compute[71308]:     </memballoon>
Apr 14 18:46:24 user nova-compute[71308]:   </devices>
Apr 14 18:46:24 user nova-compute[71308]: </domain>
Apr 14 18:46:24 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1477481393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG os_vif [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fd98adcf-fc13-45d1-a540-8d0863bcba52 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.042s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2afe22e1-00, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2afe22e1-00, col_values=(('external_ids', {'iface-id': '2afe22e1-0044-47e2-ba5f-e1d9fd6d0620', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:69:69', 'vm-uuid': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:25 user nova-compute[71308]: INFO os_vif [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00')
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No VIF found with MAC fa:16:3e:11:69:69, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497985.3561478, 8e55c721-9fad-4478-9e74-e87d0c95bc3c => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:25 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] VM Resumed (Lifecycle Event)
Apr 14 18:46:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Instance spawned successfully.
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:25 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497985.3562727, 8e55c721-9fad-4478-9e74-e87d0c95bc3c => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:25 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] VM Started (Lifecycle Event)
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:25 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:25 user nova-compute[71308]: INFO nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Took 12.54 seconds to spawn the instance on the hypervisor.
Apr 14 18:46:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:25 user nova-compute[71308]: INFO nova.compute.manager [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Took 13.44 seconds to build instance.
Apr 14 18:46:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c396dd5c-5bdd-4f16-887e-d2bd01c85132 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.579s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:26 user nova-compute[71308]: WARNING nova.compute.manager [req-922febf8-9acb-4e32-a419-a954a62a4484 req-646f99c0-2803-4207-8eed-33e8000062f0 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state active and task_state None.
Apr 14 18:46:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG nova.network.neutron [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updated VIF entry in instance network info cache for port 2afe22e1-0044-47e2-ba5f-e1d9fd6d0620. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG nova.network.neutron [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Releasing lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received event network-vif-plugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Lock "094a4a33-569e-4137-8798-743499f1046c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] Lock "094a4a33-569e-4137-8798-743499f1046c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] No waiting events found dispatching network-vif-plugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:27 user nova-compute[71308]: WARNING nova.compute.manager [req-48506f61-f8b5-4b14-b581-120a5b27d506 req-30dbd863-ffce-4fd1-8c4d-a71ba45cb775 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received unexpected event network-vif-plugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance with vm_state building and task_state spawning.
Apr 14 18:46:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:28 user nova-compute[71308]: WARNING nova.compute.manager [req-cb16c869-86b4-44b1-b474-8fb3d75c0406 req-a311bbdf-990e-4e36-aa66-72267fb16aaa service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state building and task_state spawning.
Apr 14 18:46:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:30 user nova-compute[71308]: WARNING nova.compute.manager [req-c8feefb3-ea71-4850-a38d-0c5d3a9b028d req-033e2687-d4f7-4789-bb6f-487a707dec2b service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state building and task_state spawning.
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497990.5522404, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:30 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Resumed (Lifecycle Event)
Apr 14 18:46:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance spawned successfully.
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:30 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681497990.5523567, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:30 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Started (Lifecycle Event)
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:30 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:30 user nova-compute[71308]: INFO nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Took 15.10 seconds to spawn the instance on the hypervisor.
Apr 14 18:46:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:30 user nova-compute[71308]: INFO nova.compute.manager [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Took 16.04 seconds to build instance.
Apr 14 18:46:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1c6785b6-e927-4c11-ade7-8f60a8b1491f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.158s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:37 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:46:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:37 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:46:37 user nova-compute[71308]: INFO nova.compute.claims [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Claim successful on node user
Apr 14 18:46:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:37 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:46:37 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.747s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:46:38 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:46:38 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG nova.policy [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f78850ecd8042dbac5f24113b9df70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22a362d9cb946a99c203366f88baafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:46:38 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Creating image(s)
Apr 14 18:46:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "/opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "/opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "/opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.131s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:38 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.306s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:46:39 user nova-compute[71308]: INFO nova.compute.claims [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Claim successful on node user
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.208s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk 1073741824" returned: 0 in 0.069s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.185s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Cannot resize image /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'migration_context' on Instance uuid 817f112c-d806-4800-9e4a-a3892c54bee1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Ensure instance console log exists: /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.778s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Successfully created port: 4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:46:40 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 18:46:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:46:40 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Creating image(s)
Apr 14 18:46:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "/opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "/opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "/opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "e38af69d570b2d142e0e49bfca97b29d4e15fbd1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "e38af69d570b2d142e0e49bfca97b29d4e15fbd1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG nova.policy [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6224225e832d40e986e1f145295621df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ef3347089a742cd8533322deb96b4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1.part --force-share --output=json" returned: 0 in 0.197s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG nova.virt.images [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] aac26e93-820f-4f38-ad93-d0c6602bcb5f was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1.part /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1.part /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1.converted" returned: 0 in 0.274s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Successfully updated port: 4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquired lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1.converted --force-share --output=json" returned: 0 in 0.256s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "e38af69d570b2d142e0e49bfca97b29d4e15fbd1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.392s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received event network-changed-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Refreshing instance network info cache due to event network-changed-4a744ab3-b516-4349-adfd-98d2ce4332d2. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:46:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] Acquiring lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1 --force-share --output=json" returned: 0 in 0.207s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "e38af69d570b2d142e0e49bfca97b29d4e15fbd1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "e38af69d570b2d142e0e49bfca97b29d4e15fbd1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1 --force-share --output=json" returned: 0 in 0.162s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1,backing_fmt=raw /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1,backing_fmt=raw /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk 1073741824" returned: 0 in 0.074s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "e38af69d570b2d142e0e49bfca97b29d4e15fbd1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Updating instance_info_cache with network_info: [{"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Releasing lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Instance network_info: |[{"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] Acquired lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Refreshing network info cache for port 4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Start _get_guest_xml network_info=[{"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e38af69d570b2d142e0e49bfca97b29d4e15fbd1 --force-share --output=json" returned: 0 in 0.187s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Checking if we can resize image /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:42 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:42 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-875405056',display_name='tempest-VolumesAdminNegativeTest-server-875405056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-875405056',id=6,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZS7ySskesG5sOsdo/78qFpKWUvBoA4ziFwr5nR9D/I0C4AJuScxjt9mGbYfOP2ny0gRhvcSMfmUYwkaf98qvnWLlephh7/+MOryQ3b4Xp2gDHa/s4GPuvFDf4u9butPA==',key_name='tempest-keypair-397111654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d22a362d9cb946a99c203366f88baafb',ramdisk_id='',reservation_id='r-nuiolm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-714849235',owner_user_name='tempest-VolumesAdminNegativeTest-714849235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f78850ecd8042dbac5f24113b9df70e',uuid=817f112c-d806-4800-9e4a-a3892c54bee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converting VIF {"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:88:ee,bridge_name='br-int',has_traffic_filtering=True,id=4a744ab3-b516-4349-adfd-98d2ce4332d2,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a744ab3-b5') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'pci_devices' on Instance uuid 817f112c-d806-4800-9e4a-a3892c54bee1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:46:42 user nova-compute[71308]:   <uuid>817f112c-d806-4800-9e4a-a3892c54bee1</uuid>
Apr 14 18:46:42 user nova-compute[71308]:   <name>instance-00000006</name>
Apr 14 18:46:42 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:46:42 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:46:42 user nova-compute[71308]:   <metadata>
Apr 14 18:46:42 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:46:42 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:46:42 user nova-compute[71308]:       <nova:name>tempest-VolumesAdminNegativeTest-server-875405056</nova:name>
Apr 14 18:46:42 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:46:42</nova:creationTime>
Apr 14 18:46:42 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:46:42 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:46:42 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:46:42 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:46:42 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:46:42 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:46:42 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:46:42 user nova-compute[71308]:       <nova:owner>
Apr 14 18:46:42 user nova-compute[71308]:         <nova:user uuid="3f78850ecd8042dbac5f24113b9df70e">tempest-VolumesAdminNegativeTest-714849235-project-member</nova:user>
Apr 14 18:46:42 user nova-compute[71308]:         <nova:project uuid="d22a362d9cb946a99c203366f88baafb">tempest-VolumesAdminNegativeTest-714849235</nova:project>
Apr 14 18:46:42 user nova-compute[71308]:       </nova:owner>
Apr 14 18:46:42 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:46:42 user nova-compute[71308]:       <nova:ports>
Apr 14 18:46:42 user nova-compute[71308]:         <nova:port uuid="4a744ab3-b516-4349-adfd-98d2ce4332d2">
Apr 14 18:46:42 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 18:46:42 user nova-compute[71308]:         </nova:port>
Apr 14 18:46:42 user nova-compute[71308]:       </nova:ports>
Apr 14 18:46:42 user nova-compute[71308]:     </nova:instance>
Apr 14 18:46:42 user nova-compute[71308]:   </metadata>
Apr 14 18:46:42 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:46:42 user nova-compute[71308]:     <system>
Apr 14 18:46:42 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:46:42 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:46:42 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:46:42 user nova-compute[71308]:       <entry name="serial">817f112c-d806-4800-9e4a-a3892c54bee1</entry>
Apr 14 18:46:42 user nova-compute[71308]:       <entry name="uuid">817f112c-d806-4800-9e4a-a3892c54bee1</entry>
Apr 14 18:46:42 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:46:42 user nova-compute[71308]:     </system>
Apr 14 18:46:42 user nova-compute[71308]:   </sysinfo>
Apr 14 18:46:42 user nova-compute[71308]:   <os>
Apr 14 18:46:42 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:46:42 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:46:42 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:46:42 user nova-compute[71308]:   </os>
Apr 14 18:46:42 user nova-compute[71308]:   <features>
Apr 14 18:46:42 user nova-compute[71308]:     <acpi/>
Apr 14 18:46:42 user nova-compute[71308]:     <apic/>
Apr 14 18:46:42 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:46:42 user nova-compute[71308]:   </features>
Apr 14 18:46:42 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:46:42 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:46:42 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:46:42 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:46:42 user nova-compute[71308]:   </clock>
Apr 14 18:46:42 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:46:42 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:46:42 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:46:42 user nova-compute[71308]:   </cpu>
Apr 14 18:46:42 user nova-compute[71308]:   <devices>
Apr 14 18:46:42 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:46:42 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:46:42 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk"/>
Apr 14 18:46:42 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:46:42 user nova-compute[71308]:     </disk>
Apr 14 18:46:42 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:46:42 user nova-compute[71308]:       <mac address="fa:16:3e:12:88:ee"/>
Apr 14 18:46:42 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:42 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:46:42 user nova-compute[71308]:       <target dev="tap4a744ab3-b5"/>
Apr 14 18:46:42 user nova-compute[71308]:     </interface>
Apr 14 18:46:42 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:46:42 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/console.log" append="off"/>
Apr 14 18:46:42 user nova-compute[71308]:     </serial>
Apr 14 18:46:42 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:46:42 user nova-compute[71308]:     <video>
Apr 14 18:46:42 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:42 user nova-compute[71308]:     </video>
Apr 14 18:46:42 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:46:42 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:46:42 user nova-compute[71308]:     </rng>
Apr 14 18:46:42 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:46:42 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:46:42 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:46:42 user nova-compute[71308]:     </memballoon>
Apr 14 18:46:42 user nova-compute[71308]:   </devices>
Apr 14 18:46:42 user nova-compute[71308]: </domain>
Apr 14 18:46:42 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-875405056',display_name='tempest-VolumesAdminNegativeTest-server-875405056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-875405056',id=6,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZS7ySskesG5sOsdo/78qFpKWUvBoA4ziFwr5nR9D/I0C4AJuScxjt9mGbYfOP2ny0gRhvcSMfmUYwkaf98qvnWLlephh7/+MOryQ3b4Xp2gDHa/s4GPuvFDf4u9butPA==',key_name='tempest-keypair-397111654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d22a362d9cb946a99c203366f88baafb',ramdisk_id='',reservation_id='r-nuiolm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-714849235',owner_user_name='tempest-VolumesAdminNegativeTest-714849235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f78850ecd8042dbac5f24113b9df70e',uuid=817f112c-d806-4800-9e4a-a3892c54bee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converting VIF {"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:88:ee,bridge_name='br-int',has_traffic_filtering=True,id=4a744ab3-b516-4349-adfd-98d2ce4332d2,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a744ab3-b5') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG os_vif [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:88:ee,bridge_name='br-int',has_traffic_filtering=True,id=4a744ab3-b516-4349-adfd-98d2ce4332d2,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a744ab3-b5') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Cannot resize image /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lazy-loading 'migration_context' on Instance uuid 499df49b-4a00-447b-bd2f-b027fb44f3b8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a744ab3-b5, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a744ab3-b5, col_values=(('external_ids', {'iface-id': '4a744ab3-b516-4349-adfd-98d2ce4332d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:88:ee', 'vm-uuid': '817f112c-d806-4800-9e4a-a3892c54bee1'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Ensure instance console log exists: /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:46:42 user nova-compute[71308]: INFO os_vif [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:88:ee,bridge_name='br-int',has_traffic_filtering=True,id=4a744ab3-b516-4349-adfd-98d2ce4332d2,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a744ab3-b5')
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] No VIF found with MAC fa:16:3e:12:88:ee, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:46:43 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Successfully created port: 51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:46:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Updated VIF entry in instance network info cache for port 4a744ab3-b516-4349-adfd-98d2ce4332d2. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:46:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Updating instance_info_cache with network_info: [{"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3510215f-da85-4e76-bfe8-6ab44ff0f82f req-aea0cfe9-d29f-4379-ae69-f92d8311ef1f service nova] Releasing lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received event network-vif-plugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] No waiting events found dispatching network-vif-plugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:45 user nova-compute[71308]: WARNING nova.compute.manager [req-590ade44-3ce9-4d8b-867d-2f43f3626340 req-7b63181c-20e1-41ca-bc94-482f9ff0315b service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received unexpected event network-vif-plugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance with vm_state building and task_state spawning.
Apr 14 18:46:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:46:45 user nova-compute[71308]: INFO nova.compute.claims [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Claim successful on node user
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Successfully updated port: 51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "refresh_cache-499df49b-4a00-447b-bd2f-b027fb44f3b8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquired lock "refresh_cache-499df49b-4a00-447b-bd2f-b027fb44f3b8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:46:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.policy [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:46:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Creating image(s)
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498007.1159015, 817f112c-d806-4800-9e4a-a3892c54bee1 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:47 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] VM Resumed (Lifecycle Event)
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:46:47 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Instance spawned successfully.
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.181s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:47 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498007.1165779, 817f112c-d806-4800-9e4a-a3892c54bee1 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:47 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] VM Started (Lifecycle Event)
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk 1073741824" returned: 0 in 0.060s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:47 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.163s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:47 user nova-compute[71308]: INFO nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Took 8.70 seconds to spawn the instance on the hypervisor.
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:47 user nova-compute[71308]: INFO nova.compute.manager [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Took 10.31 seconds to build instance.
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Cannot resize image /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.objects.instance [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'migration_context' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Ensure instance console log exists: /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Updating instance_info_cache with network_info: [{"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c7f035e1-65a0-467c-ac93-4d3488bb4d63 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.531s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Releasing lock "refresh_cache-499df49b-4a00-447b-bd2f-b027fb44f3b8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Instance network_info: |[{"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Start _get_guest_xml network_info=[{"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:46:27Z,direct_url=<?>,disk_format='qcow2',id=aac26e93-820f-4f38-ad93-d0c6602bcb5f,min_disk=0,min_ram=0,name='',owner='961af23443d54e10ac7d3557567b31ac',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:46:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'scsi', 'device_type': 'disk', 'image_id': 'aac26e93-820f-4f38-ad93-d0c6602bcb5f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:46:47 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:47 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:46:27Z,direct_url=<?>,disk_format='qcow2',id=aac26e93-820f-4f38-ad93-d0c6602bcb5f,min_disk=0,min_ram=0,name='',owner='961af23443d54e10ac7d3557567b31ac',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:46:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-608469179',display_name='tempest-AttachSCSIVolumeTestJSON-server-608469179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-608469179',id=7,image_ref='aac26e93-820f-4f38-ad93-d0c6602bcb5f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9u1JlSuD1cJAMQzALjI/JyGRN1rOQcOW5ycbxEjDT60K921QCb9ZxtUq1EWTeVNJbS0jsJLL5PQkFgQAgckmcDooUDCEzR2biHJb/yfJQBTKMSdOIvYWSmMVbMc7s+9Q==',key_name='tempest-keypair-1864669462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef3347089a742cd8533322deb96b4d0',ramdisk_id='',reservation_id='r-ki1uz5ox',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='aac26e93-820f-4f38-ad93-d0c6602bcb5f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1744957481',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1744957481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6224225e832d40e986e1f145295621df',uuid=499df49b-4a00-447b-bd2f-b027fb44f3b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Converting VIF {"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=51aafe60-87de-4ca9-8168-cbac2aeb557e,network=Network(a7f1f9e5-21ae-4bde-a369-ba247ce72d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51aafe60-87') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lazy-loading 'pci_devices' on Instance uuid 499df49b-4a00-447b-bd2f-b027fb44f3b8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:46:47 user nova-compute[71308]:   <uuid>499df49b-4a00-447b-bd2f-b027fb44f3b8</uuid>
Apr 14 18:46:47 user nova-compute[71308]:   <name>instance-00000007</name>
Apr 14 18:46:47 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:46:47 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:46:47 user nova-compute[71308]:   <metadata>
Apr 14 18:46:47 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:46:47 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:46:47 user nova-compute[71308]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-608469179</nova:name>
Apr 14 18:46:47 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:46:47</nova:creationTime>
Apr 14 18:46:47 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:46:47 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:46:47 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:46:47 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:46:47 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:46:47 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:46:47 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:46:47 user nova-compute[71308]:       <nova:owner>
Apr 14 18:46:47 user nova-compute[71308]:         <nova:user uuid="6224225e832d40e986e1f145295621df">tempest-AttachSCSIVolumeTestJSON-1744957481-project-member</nova:user>
Apr 14 18:46:47 user nova-compute[71308]:         <nova:project uuid="8ef3347089a742cd8533322deb96b4d0">tempest-AttachSCSIVolumeTestJSON-1744957481</nova:project>
Apr 14 18:46:47 user nova-compute[71308]:       </nova:owner>
Apr 14 18:46:47 user nova-compute[71308]:       <nova:root type="image" uuid="aac26e93-820f-4f38-ad93-d0c6602bcb5f"/>
Apr 14 18:46:47 user nova-compute[71308]:       <nova:ports>
Apr 14 18:46:47 user nova-compute[71308]:         <nova:port uuid="51aafe60-87de-4ca9-8168-cbac2aeb557e">
Apr 14 18:46:47 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 18:46:47 user nova-compute[71308]:         </nova:port>
Apr 14 18:46:47 user nova-compute[71308]:       </nova:ports>
Apr 14 18:46:47 user nova-compute[71308]:     </nova:instance>
Apr 14 18:46:47 user nova-compute[71308]:   </metadata>
Apr 14 18:46:47 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:46:47 user nova-compute[71308]:     <system>
Apr 14 18:46:47 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:46:47 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:46:47 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:46:47 user nova-compute[71308]:       <entry name="serial">499df49b-4a00-447b-bd2f-b027fb44f3b8</entry>
Apr 14 18:46:47 user nova-compute[71308]:       <entry name="uuid">499df49b-4a00-447b-bd2f-b027fb44f3b8</entry>
Apr 14 18:46:47 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:46:47 user nova-compute[71308]:     </system>
Apr 14 18:46:47 user nova-compute[71308]:   </sysinfo>
Apr 14 18:46:47 user nova-compute[71308]:   <os>
Apr 14 18:46:47 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:46:47 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:46:47 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:46:47 user nova-compute[71308]:   </os>
Apr 14 18:46:47 user nova-compute[71308]:   <features>
Apr 14 18:46:47 user nova-compute[71308]:     <acpi/>
Apr 14 18:46:47 user nova-compute[71308]:     <apic/>
Apr 14 18:46:47 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:46:47 user nova-compute[71308]:   </features>
Apr 14 18:46:47 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:46:47 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:46:47 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:46:47 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:46:47 user nova-compute[71308]:   </clock>
Apr 14 18:46:47 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:46:47 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:46:47 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:46:47 user nova-compute[71308]:   </cpu>
Apr 14 18:46:47 user nova-compute[71308]:   <devices>
Apr 14 18:46:47 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:46:47 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:46:47 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk"/>
Apr 14 18:46:47 user nova-compute[71308]:       <target dev="sda" bus="scsi"/>
Apr 14 18:46:47 user nova-compute[71308]:       <address type="drive" controller="0" unit="0"/>
Apr 14 18:46:47 user nova-compute[71308]:     </disk>
Apr 14 18:46:47 user nova-compute[71308]:     <disk type="file" device="cdrom">
Apr 14 18:46:47 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 18:46:47 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk.config"/>
Apr 14 18:46:47 user nova-compute[71308]:       <target dev="sdb" bus="scsi"/>
Apr 14 18:46:47 user nova-compute[71308]:       <address type="drive" controller="0" unit="1"/>
Apr 14 18:46:47 user nova-compute[71308]:     </disk>
Apr 14 18:46:47 user nova-compute[71308]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 18:46:47 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:46:47 user nova-compute[71308]:       <mac address="fa:16:3e:fb:94:e2"/>
Apr 14 18:46:47 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:47 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:46:47 user nova-compute[71308]:       <target dev="tap51aafe60-87"/>
Apr 14 18:46:47 user nova-compute[71308]:     </interface>
Apr 14 18:46:47 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:46:47 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/console.log" append="off"/>
Apr 14 18:46:47 user nova-compute[71308]:     </serial>
Apr 14 18:46:47 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:46:47 user nova-compute[71308]:     <video>
Apr 14 18:46:47 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:47 user nova-compute[71308]:     </video>
Apr 14 18:46:47 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:46:47 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:46:47 user nova-compute[71308]:     </rng>
Apr 14 18:46:47 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:46:47 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:46:47 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:46:47 user nova-compute[71308]:     </memballoon>
Apr 14 18:46:47 user nova-compute[71308]:   </devices>
Apr 14 18:46:47 user nova-compute[71308]: </domain>
Apr 14 18:46:47 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-608469179',display_name='tempest-AttachSCSIVolumeTestJSON-server-608469179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-608469179',id=7,image_ref='aac26e93-820f-4f38-ad93-d0c6602bcb5f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9u1JlSuD1cJAMQzALjI/JyGRN1rOQcOW5ycbxEjDT60K921QCb9ZxtUq1EWTeVNJbS0jsJLL5PQkFgQAgckmcDooUDCEzR2biHJb/yfJQBTKMSdOIvYWSmMVbMc7s+9Q==',key_name='tempest-keypair-1864669462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ef3347089a742cd8533322deb96b4d0',ramdisk_id='',reservation_id='r-ki1uz5ox',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='aac26e93-820f-4f38-ad93-d0c6602bcb5f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1744957481',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1744957481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6224225e832d40e986e1f145295621df',uuid=499df49b-4a00-447b-bd2f-b027fb44f3b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Converting VIF {"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=51aafe60-87de-4ca9-8168-cbac2aeb557e,network=Network(a7f1f9e5-21ae-4bde-a369-ba247ce72d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51aafe60-87') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG os_vif [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=51aafe60-87de-4ca9-8168-cbac2aeb557e,network=Network(a7f1f9e5-21ae-4bde-a369-ba247ce72d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51aafe60-87') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51aafe60-87, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51aafe60-87, col_values=(('external_ids', {'iface-id': '51aafe60-87de-4ca9-8168-cbac2aeb557e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:94:e2', 'vm-uuid': '499df49b-4a00-447b-bd2f-b027fb44f3b8'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:47 user nova-compute[71308]: INFO os_vif [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=51aafe60-87de-4ca9-8168-cbac2aeb557e,network=Network(a7f1f9e5-21ae-4bde-a369-ba247ce72d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51aafe60-87')
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received event network-changed-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Refreshing instance network info cache due to event network-changed-51aafe60-87de-4ca9-8168-cbac2aeb557e. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Acquiring lock "refresh_cache-499df49b-4a00-447b-bd2f-b027fb44f3b8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Acquired lock "refresh_cache-499df49b-4a00-447b-bd2f-b027fb44f3b8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.network.neutron [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Refreshing network info cache for port 51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] No BDM found with device name sda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] No VIF found with MAC fa:16:3e:fb:94:e2, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:46:47 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Using config drive
Apr 14 18:46:48 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Creating config drive at /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk.config
Apr 14 18:46:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnqunebbe {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnqunebbe" returned: 0 in 0.068s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Successfully created port: a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG nova.network.neutron [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Updated VIF entry in instance network info cache for port 51aafe60-87de-4ca9-8168-cbac2aeb557e. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG nova.network.neutron [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Updating instance_info_cache with network_info: [{"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Releasing lock "refresh_cache-499df49b-4a00-447b-bd2f-b027fb44f3b8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received event network-vif-plugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] No waiting events found dispatching network-vif-plugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:48 user nova-compute[71308]: WARNING nova.compute.manager [req-35cd842c-e37b-44b6-8ead-9b1e3cc47237 req-beaecb5b-ffcd-467c-ba87-083c7ac49c69 service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received unexpected event network-vif-plugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance with vm_state active and task_state None.
Apr 14 18:46:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:46:49 user nova-compute[71308]: INFO nova.compute.claims [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Claim successful on node user
Apr 14 18:46:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Successfully updated port: a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquired lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-changed-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Refreshing instance network info cache due to event network-changed-a23ae571-1be9-4877-b629-567eb9c62b9d. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] Acquiring lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updating instance_info_cache with network_info: [{"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Releasing lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Instance network_info: |[{"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] Acquired lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.network.neutron [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Refreshing network info cache for port a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Start _get_guest_xml network_info=[{"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:46:50 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:50 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-444984251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-444984251',id=8,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrYUmyFto3lIJuJXMBF4CtTfKVUh4V940geNTK4f4QpKuvkvp83JV/2A/URZIxQB6Rti00M04f5rrnUAVtSObiD6MPSlbY3ycoBt9DEYh9gUdRaEpFW19N4OEj4Ecmh4Q==',key_name='tempest-keypair-1208398939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efae74f239e14c29b3af28c7fceee94d',ramdisk_id='',reservation_id='r-qypqgwqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2056271432',owner_user_name='tempest-TaggedAttachmentsTest-2056271432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b083d961ab7546a7bb743d034c5e0815',uuid=e3e82a4d-89b7-4bd5-8b22-f17a019e6b99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converting VIF {"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:da:92,bridge_name='br-int',has_traffic_filtering=True,id=a23ae571-1be9-4877-b629-567eb9c62b9d,network=Network(1b859fd2-98b3-4a26-97a9-7208e978bae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23ae571-1b') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.objects.instance [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'pci_devices' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:46:50 user nova-compute[71308]:   <uuid>e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</uuid>
Apr 14 18:46:50 user nova-compute[71308]:   <name>instance-00000008</name>
Apr 14 18:46:50 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:46:50 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:46:50 user nova-compute[71308]:   <metadata>
Apr 14 18:46:50 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:46:50 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:46:50 user nova-compute[71308]:       <nova:name>tempest-device-tagging-server-444984251</nova:name>
Apr 14 18:46:50 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:46:50</nova:creationTime>
Apr 14 18:46:50 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:46:50 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:46:50 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:46:50 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:46:50 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:46:50 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:46:50 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:46:50 user nova-compute[71308]:       <nova:owner>
Apr 14 18:46:50 user nova-compute[71308]:         <nova:user uuid="b083d961ab7546a7bb743d034c5e0815">tempest-TaggedAttachmentsTest-2056271432-project-member</nova:user>
Apr 14 18:46:50 user nova-compute[71308]:         <nova:project uuid="efae74f239e14c29b3af28c7fceee94d">tempest-TaggedAttachmentsTest-2056271432</nova:project>
Apr 14 18:46:50 user nova-compute[71308]:       </nova:owner>
Apr 14 18:46:50 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:46:50 user nova-compute[71308]:       <nova:ports>
Apr 14 18:46:50 user nova-compute[71308]:         <nova:port uuid="a23ae571-1be9-4877-b629-567eb9c62b9d">
Apr 14 18:46:50 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 18:46:50 user nova-compute[71308]:         </nova:port>
Apr 14 18:46:50 user nova-compute[71308]:       </nova:ports>
Apr 14 18:46:50 user nova-compute[71308]:     </nova:instance>
Apr 14 18:46:50 user nova-compute[71308]:   </metadata>
Apr 14 18:46:50 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:46:50 user nova-compute[71308]:     <system>
Apr 14 18:46:50 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:46:50 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:46:50 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:46:50 user nova-compute[71308]:       <entry name="serial">e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</entry>
Apr 14 18:46:50 user nova-compute[71308]:       <entry name="uuid">e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</entry>
Apr 14 18:46:50 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:46:50 user nova-compute[71308]:     </system>
Apr 14 18:46:50 user nova-compute[71308]:   </sysinfo>
Apr 14 18:46:50 user nova-compute[71308]:   <os>
Apr 14 18:46:50 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:46:50 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:46:50 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:46:50 user nova-compute[71308]:   </os>
Apr 14 18:46:50 user nova-compute[71308]:   <features>
Apr 14 18:46:50 user nova-compute[71308]:     <acpi/>
Apr 14 18:46:50 user nova-compute[71308]:     <apic/>
Apr 14 18:46:50 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:46:50 user nova-compute[71308]:   </features>
Apr 14 18:46:50 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:46:50 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:46:50 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:46:50 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:46:50 user nova-compute[71308]:   </clock>
Apr 14 18:46:50 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:46:50 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:46:50 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:46:50 user nova-compute[71308]:   </cpu>
Apr 14 18:46:50 user nova-compute[71308]:   <devices>
Apr 14 18:46:50 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:46:50 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:46:50 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk"/>
Apr 14 18:46:50 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:46:50 user nova-compute[71308]:     </disk>
Apr 14 18:46:50 user nova-compute[71308]:     <disk type="file" device="cdrom">
Apr 14 18:46:50 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 18:46:50 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk.config"/>
Apr 14 18:46:50 user nova-compute[71308]:       <target dev="hda" bus="ide"/>
Apr 14 18:46:50 user nova-compute[71308]:     </disk>
Apr 14 18:46:50 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:46:50 user nova-compute[71308]:       <mac address="fa:16:3e:07:da:92"/>
Apr 14 18:46:50 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:50 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:46:50 user nova-compute[71308]:       <target dev="tapa23ae571-1b"/>
Apr 14 18:46:50 user nova-compute[71308]:     </interface>
Apr 14 18:46:50 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:46:50 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/console.log" append="off"/>
Apr 14 18:46:50 user nova-compute[71308]:     </serial>
Apr 14 18:46:50 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:46:50 user nova-compute[71308]:     <video>
Apr 14 18:46:50 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:50 user nova-compute[71308]:     </video>
Apr 14 18:46:50 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:46:50 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:46:50 user nova-compute[71308]:     </rng>
Apr 14 18:46:50 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:46:50 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:46:50 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:46:50 user nova-compute[71308]:     </memballoon>
Apr 14 18:46:50 user nova-compute[71308]:   </devices>
Apr 14 18:46:50 user nova-compute[71308]: </domain>
Apr 14 18:46:50 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-444984251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-444984251',id=8,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrYUmyFto3lIJuJXMBF4CtTfKVUh4V940geNTK4f4QpKuvkvp83JV/2A/URZIxQB6Rti00M04f5rrnUAVtSObiD6MPSlbY3ycoBt9DEYh9gUdRaEpFW19N4OEj4Ecmh4Q==',key_name='tempest-keypair-1208398939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efae74f239e14c29b3af28c7fceee94d',ramdisk_id='',reservation_id='r-qypqgwqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2056271432',owner_user_name='tempest-TaggedAttachmentsTest-2056271432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b083d961ab7546a7bb743d034c5e0815',uuid=e3e82a4d-89b7-4bd5-8b22-f17a019e6b99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converting VIF {"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:da:92,bridge_name='br-int',has_traffic_filtering=True,id=a23ae571-1be9-4877-b629-567eb9c62b9d,network=Network(1b859fd2-98b3-4a26-97a9-7208e978bae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23ae571-1b') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG os_vif [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:da:92,bridge_name='br-int',has_traffic_filtering=True,id=a23ae571-1be9-4877-b629-567eb9c62b9d,network=Network(1b859fd2-98b3-4a26-97a9-7208e978bae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23ae571-1b') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:46:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa23ae571-1b, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa23ae571-1b, col_values=(('external_ids', {'iface-id': 'a23ae571-1be9-4877-b629-567eb9c62b9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:da:92', 'vm-uuid': 'e3e82a4d-89b7-4bd5-8b22-f17a019e6b99'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:50 user nova-compute[71308]: INFO os_vif [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:da:92,bridge_name='br-int',has_traffic_filtering=True,id=a23ae571-1be9-4877-b629-567eb9c62b9d,network=Network(1b859fd2-98b3-4a26-97a9-7208e978bae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23ae571-1b')
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] No BDM found with device name hda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] No VIF found with MAC fa:16:3e:07:da:92, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:46:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Using config drive
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received event network-vif-plugged-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] No waiting events found dispatching network-vif-plugged-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:50 user nova-compute[71308]: WARNING nova.compute.manager [req-d1189278-3508-4086-a3fb-c1f2e13af368 req-c83015ac-de1b-4bd8-a9c0-967868f966e8 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received unexpected event network-vif-plugged-51aafe60-87de-4ca9-8168-cbac2aeb557e for instance with vm_state building and task_state spawning.
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:46:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Creating image(s)
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "/opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "/opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "/opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.155s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk 1073741824" returned: 0 in 0.054s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG nova.policy [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3acb40ab30d44d5ebd26c3956b6d7e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '418926b6689d48e3b7288ce32834dc93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updated VIF entry in instance network info cache for port a23ae571-1be9-4877-b629-567eb9c62b9d. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updating instance_info_cache with network_info: [{"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-93b4db1a-6449-464d-83a0-7ef325c5adfb req-542706ca-e4e8-494e-be7a-c78f61f3d866 service nova] Releasing lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.169s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Cannot resize image /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lazy-loading 'migration_context' on Instance uuid e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Ensure instance console log exists: /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Creating config drive at /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk.config
Apr 14 18:46:51 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp83zf25yj {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:51 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp83zf25yj" returned: 0 in 0.054s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498012.3623142, 499df49b-4a00-447b-bd2f-b027fb44f3b8 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:52 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] VM Resumed (Lifecycle Event)
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Successfully created port: fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:46:52 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Instance spawned successfully.
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:52 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498012.3625195, 499df49b-4a00-447b-bd2f-b027fb44f3b8 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:52 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] VM Started (Lifecycle Event)
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:52 user nova-compute[71308]: INFO nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Took 11.99 seconds to spawn the instance on the hypervisor.
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:52 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:52 user nova-compute[71308]: INFO nova.compute.manager [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Took 13.25 seconds to build instance.
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received event network-vif-plugged-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] No waiting events found dispatching network-vif-plugged-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:52 user nova-compute[71308]: WARNING nova.compute.manager [req-5d895f6f-3f18-4094-a0a5-704a42f3bbb1 req-f16e5107-abf5-424e-92cf-6ed8d7ac4ea8 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received unexpected event network-vif-plugged-51aafe60-87de-4ca9-8168-cbac2aeb557e for instance with vm_state active and task_state None.
Apr 14 18:46:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba880c26-f241-4732-9890-e545f983e0fd tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.598s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 18:46:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] There are 0 instances to clean {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71308) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Successfully updated port: fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "refresh_cache-e03adca9-8b0c-416c-943e-7dce251547c6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquired lock "refresh_cache-e03adca9-8b0c-416c-943e-7dce251547c6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Updating instance_info_cache with network_info: [{"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Releasing lock "refresh_cache-e03adca9-8b0c-416c-943e-7dce251547c6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Instance network_info: |[{"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Start _get_guest_xml network_info=[{"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:46:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-610939182',display_name='tempest-TestVolumeSwap-server-610939182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-610939182',id=9,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOcIcfC08JbrvyMMglu/V2efEjoIrZskk6UZHHoxW7DVh/jlMeXwPkJZmJMxozdeySiwAj/pr6qdWwdHomjdRl/ESLuT0VCmFkV9cmikCZjGBOAStqcadvbYVvOOci8wQ==',key_name='tempest-keypair-722895534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='418926b6689d48e3b7288ce32834dc93',ramdisk_id='',reservation_id='r-zw72v1ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1301939484',owner_user_name='tempest-TestVolumeSwap-1301939484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3acb40ab30d44d5ebd26c3956b6d7e54',uuid=e03adca9-8b0c-416c-943e-7dce251547c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Converting VIF {"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:37:70,bridge_name='br-int',has_traffic_filtering=True,id=fd4a0af3-b371-4b85-8a45-3b68d9884358,network=Network(85ad9a3e-94ad-4864-a75e-2ace633bd132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4a0af3-b3') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lazy-loading 'pci_devices' on Instance uuid e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:46:54 user nova-compute[71308]:   <uuid>e03adca9-8b0c-416c-943e-7dce251547c6</uuid>
Apr 14 18:46:54 user nova-compute[71308]:   <name>instance-00000009</name>
Apr 14 18:46:54 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:46:54 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:46:54 user nova-compute[71308]:   <metadata>
Apr 14 18:46:54 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:46:54 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:46:54 user nova-compute[71308]:       <nova:name>tempest-TestVolumeSwap-server-610939182</nova:name>
Apr 14 18:46:54 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:46:54</nova:creationTime>
Apr 14 18:46:54 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:46:54 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:46:54 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:46:54 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:46:54 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:46:54 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:46:54 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:46:54 user nova-compute[71308]:       <nova:owner>
Apr 14 18:46:54 user nova-compute[71308]:         <nova:user uuid="3acb40ab30d44d5ebd26c3956b6d7e54">tempest-TestVolumeSwap-1301939484-project-member</nova:user>
Apr 14 18:46:54 user nova-compute[71308]:         <nova:project uuid="418926b6689d48e3b7288ce32834dc93">tempest-TestVolumeSwap-1301939484</nova:project>
Apr 14 18:46:54 user nova-compute[71308]:       </nova:owner>
Apr 14 18:46:54 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:46:54 user nova-compute[71308]:       <nova:ports>
Apr 14 18:46:54 user nova-compute[71308]:         <nova:port uuid="fd4a0af3-b371-4b85-8a45-3b68d9884358">
Apr 14 18:46:54 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 18:46:54 user nova-compute[71308]:         </nova:port>
Apr 14 18:46:54 user nova-compute[71308]:       </nova:ports>
Apr 14 18:46:54 user nova-compute[71308]:     </nova:instance>
Apr 14 18:46:54 user nova-compute[71308]:   </metadata>
Apr 14 18:46:54 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:46:54 user nova-compute[71308]:     <system>
Apr 14 18:46:54 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:46:54 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:46:54 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:46:54 user nova-compute[71308]:       <entry name="serial">e03adca9-8b0c-416c-943e-7dce251547c6</entry>
Apr 14 18:46:54 user nova-compute[71308]:       <entry name="uuid">e03adca9-8b0c-416c-943e-7dce251547c6</entry>
Apr 14 18:46:54 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:46:54 user nova-compute[71308]:     </system>
Apr 14 18:46:54 user nova-compute[71308]:   </sysinfo>
Apr 14 18:46:54 user nova-compute[71308]:   <os>
Apr 14 18:46:54 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:46:54 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:46:54 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:46:54 user nova-compute[71308]:   </os>
Apr 14 18:46:54 user nova-compute[71308]:   <features>
Apr 14 18:46:54 user nova-compute[71308]:     <acpi/>
Apr 14 18:46:54 user nova-compute[71308]:     <apic/>
Apr 14 18:46:54 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:46:54 user nova-compute[71308]:   </features>
Apr 14 18:46:54 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:46:54 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:46:54 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:46:54 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:46:54 user nova-compute[71308]:   </clock>
Apr 14 18:46:54 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:46:54 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:46:54 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:46:54 user nova-compute[71308]:   </cpu>
Apr 14 18:46:54 user nova-compute[71308]:   <devices>
Apr 14 18:46:54 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:46:54 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:46:54 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk"/>
Apr 14 18:46:54 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:46:54 user nova-compute[71308]:     </disk>
Apr 14 18:46:54 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:46:54 user nova-compute[71308]:       <mac address="fa:16:3e:27:37:70"/>
Apr 14 18:46:54 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:54 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:46:54 user nova-compute[71308]:       <target dev="tapfd4a0af3-b3"/>
Apr 14 18:46:54 user nova-compute[71308]:     </interface>
Apr 14 18:46:54 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:46:54 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/console.log" append="off"/>
Apr 14 18:46:54 user nova-compute[71308]:     </serial>
Apr 14 18:46:54 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:46:54 user nova-compute[71308]:     <video>
Apr 14 18:46:54 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:46:54 user nova-compute[71308]:     </video>
Apr 14 18:46:54 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:46:54 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:46:54 user nova-compute[71308]:     </rng>
Apr 14 18:46:54 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:46:54 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:46:54 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:46:54 user nova-compute[71308]:     </memballoon>
Apr 14 18:46:54 user nova-compute[71308]:   </devices>
Apr 14 18:46:54 user nova-compute[71308]: </domain>
Apr 14 18:46:54 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-610939182',display_name='tempest-TestVolumeSwap-server-610939182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-610939182',id=9,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOcIcfC08JbrvyMMglu/V2efEjoIrZskk6UZHHoxW7DVh/jlMeXwPkJZmJMxozdeySiwAj/pr6qdWwdHomjdRl/ESLuT0VCmFkV9cmikCZjGBOAStqcadvbYVvOOci8wQ==',key_name='tempest-keypair-722895534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='418926b6689d48e3b7288ce32834dc93',ramdisk_id='',reservation_id='r-zw72v1ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1301939484',owner_user_name='tempest-TestVolumeSwap-1301939484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3acb40ab30d44d5ebd26c3956b6d7e54',uuid=e03adca9-8b0c-416c-943e-7dce251547c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Converting VIF {"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:37:70,bridge_name='br-int',has_traffic_filtering=True,id=fd4a0af3-b371-4b85-8a45-3b68d9884358,network=Network(85ad9a3e-94ad-4864-a75e-2ace633bd132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4a0af3-b3') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG os_vif [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:37:70,bridge_name='br-int',has_traffic_filtering=True,id=fd4a0af3-b371-4b85-8a45-3b68d9884358,network=Network(85ad9a3e-94ad-4864-a75e-2ace633bd132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4a0af3-b3') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd4a0af3-b3, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd4a0af3-b3, col_values=(('external_ids', {'iface-id': 'fd4a0af3-b371-4b85-8a45-3b68d9884358', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:37:70', 'vm-uuid': 'e03adca9-8b0c-416c-943e-7dce251547c6'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:54 user nova-compute[71308]: INFO os_vif [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:37:70,bridge_name='br-int',has_traffic_filtering=True,id=fd4a0af3-b371-4b85-8a45-3b68d9884358,network=Network(85ad9a3e-94ad-4864-a75e-2ace633bd132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4a0af3-b3')
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] No VIF found with MAC fa:16:3e:27:37:70, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received event network-changed-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Refreshing instance network info cache due to event network-changed-fd4a0af3-b371-4b85-8a45-3b68d9884358. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Acquiring lock "refresh_cache-e03adca9-8b0c-416c-943e-7dce251547c6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Acquired lock "refresh_cache-e03adca9-8b0c-416c-943e-7dce251547c6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:46:54 user nova-compute[71308]: DEBUG nova.network.neutron [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Refreshing network info cache for port fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.network.neutron [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Updated VIF entry in instance network info cache for port fd4a0af3-b371-4b85-8a45-3b68d9884358. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.network.neutron [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Updating instance_info_cache with network_info: [{"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Releasing lock "refresh_cache-e03adca9-8b0c-416c-943e-7dce251547c6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:55 user nova-compute[71308]: WARNING nova.compute.manager [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d for instance with vm_state building and task_state spawning.
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:55 user nova-compute[71308]: WARNING nova.compute.manager [req-8700ee74-9ab5-4ddd-9801-50d0a0b47eca req-b19edc82-703b-407a-b595-8c306098d94c service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d for instance with vm_state building and task_state spawning.
Apr 14 18:46:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498015.746509, e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:55 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] VM Resumed (Lifecycle Event)
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:46:55 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Instance spawned successfully.
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:55 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498015.7467678, e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:55 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] VM Started (Lifecycle Event)
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:55 user nova-compute[71308]: INFO nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Took 9.10 seconds to spawn the instance on the hypervisor.
Apr 14 18:46:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:55 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:56 user nova-compute[71308]: INFO nova.compute.manager [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Took 10.27 seconds to build instance.
Apr 14 18:46:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4391031d-8c9c-49fc-9412-42d9e65dea69 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.396s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:56 user nova-compute[71308]: DEBUG nova.compute.manager [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received event network-vif-plugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:56 user nova-compute[71308]: DEBUG nova.compute.manager [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] No waiting events found dispatching network-vif-plugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:56 user nova-compute[71308]: WARNING nova.compute.manager [req-878073ce-67da-42f8-b84b-d06b282e4ad0 req-56177a7a-8733-4e22-8423-b916a020e5ad service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received unexpected event network-vif-plugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance with vm_state building and task_state spawning.
Apr 14 18:46:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.383s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498018.6216006, e03adca9-8b0c-416c-943e-7dce251547c6 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:58 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] VM Resumed (Lifecycle Event)
Apr 14 18:46:58 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Instance spawned successfully.
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:46:58 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498018.6400034, e03adca9-8b0c-416c-943e-7dce251547c6 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:46:58 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] VM Started (Lifecycle Event)
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received event network-vif-plugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] No waiting events found dispatching network-vif-plugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:46:58 user nova-compute[71308]: WARNING nova.compute.manager [req-a52455a3-0a74-4355-ad84-1d03e7c5f870 req-286d41d5-70a9-4c9f-8e01-6b3285883b42 service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received unexpected event network-vif-plugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance with vm_state building and task_state spawning.
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:58 user nova-compute[71308]: INFO nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Took 8.27 seconds to spawn the instance on the hypervisor.
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:46:58 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:59 user nova-compute[71308]: INFO nova.compute.manager [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Took 9.52 seconds to build instance.
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c4230c64-23c9-4e80-9bbb-901c9d8ef532 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.651s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:46:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:01 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:01 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7756MB free_disk=26.741107940673828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 094a4a33-569e-4137-8798-743499f1046c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 817f112c-d806-4800-9e4a-a3892c54bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance e03adca9-8b0c-416c-943e-7dce251547c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "a3378ec4-364a-4656-ac99-500be9d40749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:47:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.900s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:47:02 user nova-compute[71308]: INFO nova.compute.claims [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Claim successful on node user
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Refreshing inventories for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Updating ProviderTree inventory for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Updating inventory in ProviderTree for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Refreshing aggregate associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, aggregates: None {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Refreshing trait associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.734s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:47:02 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Skipping network cache update for instance because it is Building. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 18:47:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:47:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:03 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:47:03 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lazy-loading 'info_cache' on Instance uuid 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:47:03 user nova-compute[71308]: INFO nova.virt.block_device [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Booting with volume 0ec2c8d4-acb4-4707-937f-3834d2130019 at /dev/vda
Apr 14 18:47:03 user nova-compute[71308]: DEBUG nova.policy [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4dc36f0048042929d1230f99e2be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ec916e861d448a853251f522699446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:47:03 user nova-compute[71308]: DEBUG os_brick.utils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:47:03 user nova-compute[71308]: INFO oslo.privsep.daemon [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp_cm8g991/privsep.sock']
Apr 14 18:47:03 user sudo[81541]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp_cm8g991/privsep.sock
Apr 14 18:47:03 user sudo[81541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 18:47:04 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updating instance_info_cache with network_info: [{"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:04 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully created port: 6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:05 user sudo[81541]: pam_unix(sudo:session): session closed for user root
Apr 14 18:47:05 user nova-compute[71308]: INFO oslo.privsep.daemon [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Spawned new privsep daemon via rootwrap
Apr 14 18:47:05 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 18:47:05 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 18:47:05 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 18:47:05 user nova-compute[71308]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81547
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e99f7-28b5-4db1-8bf7-b59b24c739bf]: (2,) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[97608830-ac6f-4a69-8d93-33d13c961033]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:05 user nova-compute[71308]: WARNING os_brick.initiator.connectors.nvmeof [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fc5f0b-613d-45ee-9365-0d03c9d13635]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[632a2aef-0bec-417c-8843-ab5110b4b329]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c9496-722c-49fc-b4b1-c3c42ea47a45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:47:05 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:47:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feaf11a-4536-4a14-b03e-5b3620650cc7]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG os_brick.utils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] <== get_connector_properties: return (2237ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating existing volume attachment record: 3b8362c1-623f-4a2d-9874-e31f897ebca1 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:47:05 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully created port: 1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:47:06 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully created port: 3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:47:07 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully created port: b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:47:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:08 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully created port: 85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully updated port: 6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG nova.compute.manager [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-changed-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG nova.compute.manager [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing instance network info cache due to event network-changed-6690e4a9-1979-4050-a6cc-b8fb4c413d24. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] Acquiring lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] Acquired lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG nova.network.neutron [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing network info cache for port 6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG nova.network.neutron [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG nova.network.neutron [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-62eb38ad-959a-4040-b144-61690a60b691 req-f0040058-df6d-4384-b6dd-7422c6f61d8a service nova] Releasing lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:10 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully updated port: 83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:47:10 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully updated port: d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-changed-83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing instance network info cache due to event network-changed-83687b87-4245-4c8f-9a7e-d18dd00942d3. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Acquiring lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Acquired lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.network.neutron [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing network info cache for port 83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.network.neutron [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.network.neutron [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Releasing lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-changed-d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing instance network info cache due to event network-changed-d30907fa-2785-4ffe-8552-7221fbff7200. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Acquiring lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Acquired lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.network.neutron [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing network info cache for port d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.network.neutron [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:47:11 user nova-compute[71308]: INFO nova.virt.block_device [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Booting with volume 382a8e93-fd2e-41aa-b8a2-b2458e16c786 at /dev/vdb
Apr 14 18:47:11 user nova-compute[71308]: DEBUG os_brick.utils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e856321-25b0-42fe-8659-c2c57ab62192]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:47:11 user nova-compute[71308]: INFO nova.compute.claims [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Claim successful on node user
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f562ce-f2fa-4c49-b4b5-5bff196f0c7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[517eff01-f234-4d8d-9584-9600405b2549]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7200f03-303b-4a6c-b6ab-65ed5dbb25e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:47:12 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[93842dc4-cad0-4eb9-be4a-78daaf181c02]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG os_brick.utils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating existing volume attachment record: 5483bf7f-d408-42b2-bba6-e9037acde8e1 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.network.neutron [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6e9b0062-ecd9-4849-823c-e742d163055a req-f55767b6-07c5-4df7-89ab-826bf05358d7 service nova] Releasing lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully updated port: 1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:47:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:47:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Creating image(s)
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "/opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "/opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "/opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "aca73e55d3fb41956b96766c5108df378ca6dd8e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "aca73e55d3fb41956b96766c5108df378ca6dd8e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG nova.policy [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:47:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e.part --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.virt.images [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 9c46cc77-fd07-48b5-b135-2c845b3f989e was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e.part /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully updated port: 3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-changed-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing instance network info cache due to event network-changed-1e979f27-58d7-4973-b70d-f3ca1c5811c5. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Acquiring lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Acquired lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.network.neutron [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing network info cache for port 1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e.part /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e.converted" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.network.neutron [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "aca73e55d3fb41956b96766c5108df378ca6dd8e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.762s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "aca73e55d3fb41956b96766c5108df378ca6dd8e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "aca73e55d3fb41956b96766c5108df378ca6dd8e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Successfully created port: 324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e,backing_fmt=raw /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.network.neutron [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e,backing_fmt=raw /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk 1073741824" returned: 0 in 0.050s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "aca73e55d3fb41956b96766c5108df378ca6dd8e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Releasing lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-changed-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing instance network info cache due to event network-changed-3e05363d-18d0-4fb0-9c3e-40df44246913. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Acquiring lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Acquired lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.network.neutron [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing network info cache for port 3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:13 user nova-compute[71308]: DEBUG nova.network.neutron [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Cannot resize image /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'migration_context' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Ensure instance console log exists: /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG nova.network.neutron [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9b0585f8-4098-436f-b8d1-2ffbc249bd1a req-f4ef8fa1-4ed7-4aa5-a500-15c47675e613 service nova] Releasing lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully updated port: b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Successfully updated port: 324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquired lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.compute.manager [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-changed-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.compute.manager [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing instance network info cache due to event network-changed-b24d8534-70cf-4575-a8f1-f99b5e48b7db. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Acquiring lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Acquired lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.neutron [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing network info cache for port b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.neutron [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updating instance_info_cache with network_info: [{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Releasing lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Instance network_info: |[{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Start _get_guest_xml network_info=[{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:47:09Z,direct_url=<?>,disk_format='qcow2',id=9c46cc77-fd07-48b5-b135-2c845b3f989e,min_disk=0,min_ram=0,name='tempest-scenario-img--621975333',owner='8e6b4e98cf9e4f96b79c3288dfe0da89',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:47:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '9c46cc77-fd07-48b5-b135-2c845b3f989e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:47:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:47:09Z,direct_url=<?>,disk_format='qcow2',id=9c46cc77-fd07-48b5-b135-2c845b3f989e,min_disk=0,min_ram=0,name='tempest-scenario-img--621975333',owner='8e6b4e98cf9e4f96b79c3288dfe0da89',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:47:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1753205108',display_name='tempest-TestMinimumBasicScenario-server-1753205108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1753205108',id=11,image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfCIaR3De/nNGfooewBKCs9Yqqif5k/8sNuCO7uN+hT9gFX4X7nnxenq2rxaGh4ksI9KaiGl0rKmMnWTxru18ybbLxqXOX8NwZxXuMtVOfaCykoVao1yh+Ul0yBt13edA==',key_name='tempest-TestMinimumBasicScenario-299923261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e6b4e98cf9e4f96b79c3288dfe0da89',ramdisk_id='',reservation_id='r-6cmj1cxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1257841115',owner_user_name='tempest-TestMinimumBasicScenario-1257841115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:13Z,user_data=None,user_id='67e1d31c2d9048699758779dedf7d3ac',uuid=656b9f90-ce93-42cd-aa1b-3ff868162aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converting VIF {"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'pci_devices' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Successfully updated port: 85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:47:15 user nova-compute[71308]:   <uuid>656b9f90-ce93-42cd-aa1b-3ff868162aae</uuid>
Apr 14 18:47:15 user nova-compute[71308]:   <name>instance-0000000b</name>
Apr 14 18:47:15 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:47:15 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:47:15 user nova-compute[71308]:   <metadata>
Apr 14 18:47:15 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:47:15 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:47:15 user nova-compute[71308]:       <nova:name>tempest-TestMinimumBasicScenario-server-1753205108</nova:name>
Apr 14 18:47:15 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:47:15</nova:creationTime>
Apr 14 18:47:15 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:47:15 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:47:15 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:47:15 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:47:15 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:47:15 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:47:15 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:47:15 user nova-compute[71308]:       <nova:owner>
Apr 14 18:47:15 user nova-compute[71308]:         <nova:user uuid="67e1d31c2d9048699758779dedf7d3ac">tempest-TestMinimumBasicScenario-1257841115-project-member</nova:user>
Apr 14 18:47:15 user nova-compute[71308]:         <nova:project uuid="8e6b4e98cf9e4f96b79c3288dfe0da89">tempest-TestMinimumBasicScenario-1257841115</nova:project>
Apr 14 18:47:15 user nova-compute[71308]:       </nova:owner>
Apr 14 18:47:15 user nova-compute[71308]:       <nova:root type="image" uuid="9c46cc77-fd07-48b5-b135-2c845b3f989e"/>
Apr 14 18:47:15 user nova-compute[71308]:       <nova:ports>
Apr 14 18:47:15 user nova-compute[71308]:         <nova:port uuid="324b6810-d265-48bc-a2a9-ff7d4759a910">
Apr 14 18:47:15 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 18:47:15 user nova-compute[71308]:         </nova:port>
Apr 14 18:47:15 user nova-compute[71308]:       </nova:ports>
Apr 14 18:47:15 user nova-compute[71308]:     </nova:instance>
Apr 14 18:47:15 user nova-compute[71308]:   </metadata>
Apr 14 18:47:15 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:47:15 user nova-compute[71308]:     <system>
Apr 14 18:47:15 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:47:15 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:47:15 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:47:15 user nova-compute[71308]:       <entry name="serial">656b9f90-ce93-42cd-aa1b-3ff868162aae</entry>
Apr 14 18:47:15 user nova-compute[71308]:       <entry name="uuid">656b9f90-ce93-42cd-aa1b-3ff868162aae</entry>
Apr 14 18:47:15 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:47:15 user nova-compute[71308]:     </system>
Apr 14 18:47:15 user nova-compute[71308]:   </sysinfo>
Apr 14 18:47:15 user nova-compute[71308]:   <os>
Apr 14 18:47:15 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:47:15 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:47:15 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:47:15 user nova-compute[71308]:   </os>
Apr 14 18:47:15 user nova-compute[71308]:   <features>
Apr 14 18:47:15 user nova-compute[71308]:     <acpi/>
Apr 14 18:47:15 user nova-compute[71308]:     <apic/>
Apr 14 18:47:15 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:47:15 user nova-compute[71308]:   </features>
Apr 14 18:47:15 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:47:15 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:47:15 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:47:15 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:47:15 user nova-compute[71308]:   </clock>
Apr 14 18:47:15 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:47:15 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:47:15 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:47:15 user nova-compute[71308]:   </cpu>
Apr 14 18:47:15 user nova-compute[71308]:   <devices>
Apr 14 18:47:15 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:47:15 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:47:15 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk"/>
Apr 14 18:47:15 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:47:15 user nova-compute[71308]:     </disk>
Apr 14 18:47:15 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:47:15 user nova-compute[71308]:       <mac address="fa:16:3e:75:42:3b"/>
Apr 14 18:47:15 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:15 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:47:15 user nova-compute[71308]:       <target dev="tap324b6810-d2"/>
Apr 14 18:47:15 user nova-compute[71308]:     </interface>
Apr 14 18:47:15 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:47:15 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/console.log" append="off"/>
Apr 14 18:47:15 user nova-compute[71308]:     </serial>
Apr 14 18:47:15 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:47:15 user nova-compute[71308]:     <video>
Apr 14 18:47:15 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:15 user nova-compute[71308]:     </video>
Apr 14 18:47:15 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:47:15 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:47:15 user nova-compute[71308]:     </rng>
Apr 14 18:47:15 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:47:15 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:47:15 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:47:15 user nova-compute[71308]:     </memballoon>
Apr 14 18:47:15 user nova-compute[71308]:   </devices>
Apr 14 18:47:15 user nova-compute[71308]: </domain>
Apr 14 18:47:15 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1753205108',display_name='tempest-TestMinimumBasicScenario-server-1753205108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1753205108',id=11,image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfCIaR3De/nNGfooewBKCs9Yqqif5k/8sNuCO7uN+hT9gFX4X7nnxenq2rxaGh4ksI9KaiGl0rKmMnWTxru18ybbLxqXOX8NwZxXuMtVOfaCykoVao1yh+Ul0yBt13edA==',key_name='tempest-TestMinimumBasicScenario-299923261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e6b4e98cf9e4f96b79c3288dfe0da89',ramdisk_id='',reservation_id='r-6cmj1cxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1257841115',owner_user_name='tempest-TestMinimumBasicScenario-1257841115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:13Z,user_data=None,user_id='67e1d31c2d9048699758779dedf7d3ac',uuid=656b9f90-ce93-42cd-aa1b-3ff868162aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converting VIF {"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG os_vif [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap324b6810-d2, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap324b6810-d2, col_values=(('external_ids', {'iface-id': '324b6810-d265-48bc-a2a9-ff7d4759a910', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:42:3b', 'vm-uuid': '656b9f90-ce93-42cd-aa1b-3ff868162aae'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:15 user nova-compute[71308]: INFO os_vif [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2')
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No VIF found with MAC fa:16:3e:75:42:3b, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:47:15 user nova-compute[71308]: DEBUG nova.network.neutron [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Releasing lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing instance network info cache due to event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Acquiring lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Acquired lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG nova.network.neutron [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquired lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG nova.network.neutron [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updated VIF entry in instance network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG nova.network.neutron [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updating instance_info_cache with network_info: [{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-499188e6-ba65-4718-abc4-a924b2150959 req-fdbe14de-9d96-41a7-b046-527895ae201e service nova] Releasing lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-changed-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing instance network info cache due to event network-changed-85e8f915-2217-47d4-a9a8-74be630b2b10. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Acquiring lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [{"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Releasing lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance network_info: |[{"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Acquired lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG nova.network.neutron [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing network info cache for port 85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG nova.network.neutron [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updated VIF entry in instance network info cache for port 85e8f915-2217-47d4-a9a8-74be630b2b10. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG nova.network.neutron [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [{"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Releasing lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] No waiting events found dispatching network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:18 user nova-compute[71308]: WARNING nova.compute.manager [req-5ddd7efe-526c-48ed-b940-bc4952316e96 req-60ff5f66-fb0d-4e6b-bfab-627a16eb111f service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received unexpected event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 for instance with vm_state building and task_state spawning.
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.virt.block_device [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Booting with volume 330b8b4e-5b68-43de-b1fb-f661060cc9ca at /dev/vdc
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG os_brick.utils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b943c69b-dcca-4c7f-92e7-1f964a578999]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.compute.claims [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Claim successful on node user
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dc91f4-2caf-4c8f-a216-e1189d9eb539]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c112449c-3372-4fb3-bbe0-c00cd71fefa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5b3a50-bdea-4ed2-aae2-671a8ae76e43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:47:19 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[404ed78c-e8ba-42c8-a474-f0a239999828]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG os_brick.utils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating existing volume attachment record: 1fc27263-5bc3-485f-9e76-8ff37db0971e {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] No waiting events found dispatching network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:19 user nova-compute[71308]: WARNING nova.compute.manager [req-50039d5e-c76e-4553-8491-5b6babb68ab6 req-3b8d93b9-69e1-47fc-9297-206d154b540b service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received unexpected event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 for instance with vm_state building and task_state spawning.
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498039.4608264, 656b9f90-ce93-42cd-aa1b-3ff868162aae => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] VM Resumed (Lifecycle Event)
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Instance spawned successfully.
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498039.4642742, 656b9f90-ce93-42cd-aa1b-3ff868162aae => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] VM Started (Lifecycle Event)
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Took 6.91 seconds to spawn the instance on the hypervisor.
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.compute.manager [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Took 7.74 seconds to build instance.
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b3d66582-bd90-4667-94f6-14107b33f7f5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.864s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:47:19 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:47:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:47:20 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Creating image(s)
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "/opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "/opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG nova.policy [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f3f788e144c46e7bdf6f4fe3a5aeb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95319509fb6a4e58998703975370877a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk 1073741824" returned: 0 in 0.055s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Cannot resize image /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG nova.objects.instance [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'migration_context' on Instance uuid 2c4f47d7-95da-4a01-b6e6-eb14933fede7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Ensure instance console log exists: /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:20 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Successfully created port: 58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:47:21 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Successfully updated port: 58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:47:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "refresh_cache-2c4f47d7-95da-4a01-b6e6-eb14933fede7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquired lock "refresh_cache-2c4f47d7-95da-4a01-b6e6-eb14933fede7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:21 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:47:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received event network-changed-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Refreshing instance network info cache due to event network-changed-58380bee-fc13-4cb4-880d-8f6ce124b16f. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:47:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] Acquiring lock "refresh_cache-2c4f47d7-95da-4a01-b6e6-eb14933fede7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:47:21 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Updating instance_info_cache with network_info: [{"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Releasing lock "refresh_cache-2c4f47d7-95da-4a01-b6e6-eb14933fede7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Instance network_info: |[{"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] Acquired lock "refresh_cache-2c4f47d7-95da-4a01-b6e6-eb14933fede7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.network.neutron [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Refreshing network info cache for port 58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Start _get_guest_xml network_info=[{"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:47:22 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:22 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1069322477',display_name='tempest-VolumesSnapshotTestJSON-instance-1069322477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1069322477',id=12,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95319509fb6a4e58998703975370877a',ramdisk_id='',reservation_id='r-bw0savjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1033700636',owner_user_name='tempest-VolumesSnapshotTestJSON-1033700636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:20Z,user_data=None,user_id='1f3f788e144c46e7bdf6f4fe3a5aeb79',uuid=2c4f47d7-95da-4a01-b6e6-eb14933fede7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converting VIF {"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:f6:3d,bridge_name='br-int',has_traffic_filtering=True,id=58380bee-fc13-4cb4-880d-8f6ce124b16f,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58380bee-fc') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.objects.instance [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c4f47d7-95da-4a01-b6e6-eb14933fede7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:47:22 user nova-compute[71308]:   <uuid>2c4f47d7-95da-4a01-b6e6-eb14933fede7</uuid>
Apr 14 18:47:22 user nova-compute[71308]:   <name>instance-0000000c</name>
Apr 14 18:47:22 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:47:22 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:47:22 user nova-compute[71308]:   <metadata>
Apr 14 18:47:22 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:47:22 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:47:22 user nova-compute[71308]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1069322477</nova:name>
Apr 14 18:47:22 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:47:22</nova:creationTime>
Apr 14 18:47:22 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:47:22 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:47:22 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:47:22 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:47:22 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:47:22 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:47:22 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:47:22 user nova-compute[71308]:       <nova:owner>
Apr 14 18:47:22 user nova-compute[71308]:         <nova:user uuid="1f3f788e144c46e7bdf6f4fe3a5aeb79">tempest-VolumesSnapshotTestJSON-1033700636-project-member</nova:user>
Apr 14 18:47:22 user nova-compute[71308]:         <nova:project uuid="95319509fb6a4e58998703975370877a">tempest-VolumesSnapshotTestJSON-1033700636</nova:project>
Apr 14 18:47:22 user nova-compute[71308]:       </nova:owner>
Apr 14 18:47:22 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:47:22 user nova-compute[71308]:       <nova:ports>
Apr 14 18:47:22 user nova-compute[71308]:         <nova:port uuid="58380bee-fc13-4cb4-880d-8f6ce124b16f">
Apr 14 18:47:22 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 18:47:22 user nova-compute[71308]:         </nova:port>
Apr 14 18:47:22 user nova-compute[71308]:       </nova:ports>
Apr 14 18:47:22 user nova-compute[71308]:     </nova:instance>
Apr 14 18:47:22 user nova-compute[71308]:   </metadata>
Apr 14 18:47:22 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:47:22 user nova-compute[71308]:     <system>
Apr 14 18:47:22 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:47:22 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:47:22 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:47:22 user nova-compute[71308]:       <entry name="serial">2c4f47d7-95da-4a01-b6e6-eb14933fede7</entry>
Apr 14 18:47:22 user nova-compute[71308]:       <entry name="uuid">2c4f47d7-95da-4a01-b6e6-eb14933fede7</entry>
Apr 14 18:47:22 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:47:22 user nova-compute[71308]:     </system>
Apr 14 18:47:22 user nova-compute[71308]:   </sysinfo>
Apr 14 18:47:22 user nova-compute[71308]:   <os>
Apr 14 18:47:22 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:47:22 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:47:22 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:47:22 user nova-compute[71308]:   </os>
Apr 14 18:47:22 user nova-compute[71308]:   <features>
Apr 14 18:47:22 user nova-compute[71308]:     <acpi/>
Apr 14 18:47:22 user nova-compute[71308]:     <apic/>
Apr 14 18:47:22 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:47:22 user nova-compute[71308]:   </features>
Apr 14 18:47:22 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:47:22 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:47:22 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:47:22 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:47:22 user nova-compute[71308]:   </clock>
Apr 14 18:47:22 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:47:22 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:47:22 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:47:22 user nova-compute[71308]:   </cpu>
Apr 14 18:47:22 user nova-compute[71308]:   <devices>
Apr 14 18:47:22 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:47:22 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:47:22 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk"/>
Apr 14 18:47:22 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:47:22 user nova-compute[71308]:     </disk>
Apr 14 18:47:22 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:47:22 user nova-compute[71308]:       <mac address="fa:16:3e:32:f6:3d"/>
Apr 14 18:47:22 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:22 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:47:22 user nova-compute[71308]:       <target dev="tap58380bee-fc"/>
Apr 14 18:47:22 user nova-compute[71308]:     </interface>
Apr 14 18:47:22 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:47:22 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/console.log" append="off"/>
Apr 14 18:47:22 user nova-compute[71308]:     </serial>
Apr 14 18:47:22 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:47:22 user nova-compute[71308]:     <video>
Apr 14 18:47:22 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:22 user nova-compute[71308]:     </video>
Apr 14 18:47:22 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:47:22 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:47:22 user nova-compute[71308]:     </rng>
Apr 14 18:47:22 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:47:22 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:47:22 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:47:22 user nova-compute[71308]:     </memballoon>
Apr 14 18:47:22 user nova-compute[71308]:   </devices>
Apr 14 18:47:22 user nova-compute[71308]: </domain>
Apr 14 18:47:22 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1069322477',display_name='tempest-VolumesSnapshotTestJSON-instance-1069322477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1069322477',id=12,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95319509fb6a4e58998703975370877a',ramdisk_id='',reservation_id='r-bw0savjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1033700636',owner_user_name='tempest-VolumesSnapshotTestJSON-1033700636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:20Z,user_data=None,user_id='1f3f788e144c46e7bdf6f4fe3a5aeb79',uuid=2c4f47d7-95da-4a01-b6e6-eb14933fede7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converting VIF {"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:f6:3d,bridge_name='br-int',has_traffic_filtering=True,id=58380bee-fc13-4cb4-880d-8f6ce124b16f,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58380bee-fc') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG os_vif [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:f6:3d,bridge_name='br-int',has_traffic_filtering=True,id=58380bee-fc13-4cb4-880d-8f6ce124b16f,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58380bee-fc') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58380bee-fc, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58380bee-fc, col_values=(('external_ids', {'iface-id': '58380bee-fc13-4cb4-880d-8f6ce124b16f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:f6:3d', 'vm-uuid': '2c4f47d7-95da-4a01-b6e6-eb14933fede7'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:22 user nova-compute[71308]: INFO os_vif [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:f6:3d,bridge_name='br-int',has_traffic_filtering=True,id=58380bee-fc13-4cb4-880d-8f6ce124b16f,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58380bee-fc')
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No VIF found with MAC fa:16:3e:32:f6:3d, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.network.neutron [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Updated VIF entry in instance network info cache for port 58380bee-fc13-4cb4-880d-8f6ce124b16f. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG nova.network.neutron [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Updating instance_info_cache with network_info: [{"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:47:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fa4f94f7-dc93-482e-871d-600ebcfa8dd1 req-882ed8f7-eff9-4417-b255-76f1b7f7329b service nova] Releasing lock "refresh_cache-2c4f47d7-95da-4a01-b6e6-eb14933fede7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:47:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received event network-vif-plugged-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] No waiting events found dispatching network-vif-plugged-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:24 user nova-compute[71308]: WARNING nova.compute.manager [req-29edb05e-a7ae-4fee-aeb3-738a913708ed req-a6c02575-e314-470e-a28b-291618a6ac72 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received unexpected event network-vif-plugged-58380bee-fc13-4cb4-880d-8f6ce124b16f for instance with vm_state building and task_state spawning.
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:47:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Creating image(s)
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Ensure instance console log exists: /opt/stack/data/nova/instances/a3378ec4-364a-4656-ac99-500be9d40749/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Start _get_guest_xml network_info=[{"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '3b8362c1-623f-4a2d-9874-e31f897ebca1', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrawJeUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3378ec4-364a-4656-ac99-500be9d40749', 'attached_at': '', 'detached_at': '', 'volume_id': '0ec2c8d4-acb4-4707-937f-3834d2130019', 'serial': '0ec2c8d4-acb4-4707-937f-3834d2130019'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '5483bf7f-d408-42b2-bba6-e9037acde8e1', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpPOxfsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3378ec4-364a-4656-ac99-500be9d40749', 'attached_at': '', 'detached_at': '', 'volume_id': '382a8e93-fd2e-41aa-b8a2-b2458e16c786', 'serial': '382a8e93-fd2e-41aa-b8a2-b2458e16c786'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '1fc27263-5bc3-485f-9e76-8ff37db0971e', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HANrcBMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3378ec4-364a-4656-ac99-500be9d40749', 'attached_at': '', 'detached_at': '', 'volume_id': '330b8b4e-5b68-43de-b1fb-f661060cc9ca', 'serial': '330b8b4e-5b68-43de-b1fb-f661060cc9ca'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:47:24 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:24 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connector [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Factory for ISCSI on None {{(pid=71308) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrawJeUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:47:24 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:47:24 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:47:24 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2727fb0-9387-4819-9049-567c206af48d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:47:24 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf78034-fc2a-4c97-8ba5-49bb083c6778]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019] added
Apr 14 18:47:24 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec9723-af91-4e64-b640-8332a72b04f9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[626120de-7003-4144-82bd-0838e6ed3a4d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrawJeUs {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mrawJeUs" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9b03c2-3856-4798-ae56-9b3974bb437e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mrawJeUs'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c389562-2850-4b57-b259-759e6f56de31]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f299595-39b4-445e-8399-a1ab987f6957]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 18:47:24 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 18:47:24 user nova-compute[71308]:  {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:47:24 user nova-compute[71308]: WARNING os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 18:47:24 user nova-compute[71308]: 
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[349072b3-6cc9-4268-93f3-a55c6bc5c21f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019, portal: 172.16.0.220,3260]
Apr 14 18:47:24 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019, portal: 172.16.0.220,3260] successful.
Apr 14 18:47:24 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[334e76d8-e5df-49f9-b02c-453242dabfe8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b225d115-ce3f-4ddf-8d8e-469f5cc0fd86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:24 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:24 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[957c1849-dffc-4cac-819e-a9139b19e157]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:47:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrawJeUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26437393732653338', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437393732653338', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpPOxfsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:47:25 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:47:25 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:47:25 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02786a1-3944-453f-afe8-4d6ea69363da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:47:25 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f72f71-e368-4698-b85f-d4a8ad0220f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786] added
Apr 14 18:47:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8a9feb-6a42-47d9-92ba-3d9508cb8e99]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaeaed5-2ac8-4a65-b943-0715fd84e99a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpPOxfsL {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpPOxfsL" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7893ae16-9b34-4604-8546-6d61a237dc59]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpPOxfsL'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1332e8a8-a267-4b5e-b153-59706422bacc]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[38682ce9-be63-4c58-918f-c7129193552a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:47:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b071c95-66b0-41ba-abaa-b07670c931f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786, portal: 172.16.0.220,3260]
Apr 14 18:47:26 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786, portal: 172.16.0.220,3260] successful.
Apr 14 18:47:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bda1ba-a987-4727-820c-12a61f59558d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498046.0799851, 2c4f47d7-95da-4a01-b6e6-eb14933fede7 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:47:26 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] VM Resumed (Lifecycle Event)
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:47:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Instance spawned successfully.
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6773fd68-2867-4be7-bbfc-025a1fef3b31]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:26 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:47:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:26 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:47:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f470ac6-4736-452d-8b8c-572ef9fe460b]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpPOxfsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:47:26 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498046.0813732, 2c4f47d7-95da-4a01-b6e6-eb14933fede7 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:47:26 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] VM Started (Lifecycle Event)
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:47:26 user nova-compute[71308]: INFO nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Took 6.18 seconds to spawn the instance on the hypervisor.
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:26 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:47:26 user nova-compute[71308]: INFO nova.compute.manager [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Took 6.98 seconds to build instance.
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdb427f8-7a2d-4216-81b5-bbf6d99cd41d tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.080s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received event network-vif-plugged-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] No waiting events found dispatching network-vif-plugged-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:26 user nova-compute[71308]: WARNING nova.compute.manager [req-e2c0a6c0-f6c1-4617-a428-9e97237e0507 req-0232c4a7-465c-4189-8f94-0710242deeea service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received unexpected event network-vif-plugged-58380bee-fc13-4cb4-880d-8f6ce124b16f for instance with vm_state active and task_state None.
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23633393737376562', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633393737376562', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HANrcBMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:47:27 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:47:27 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:47:27 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0ec8b8-9f4d-4089-a20d-6c4d1413de8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:47:27 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bce90b-de01-497e-923d-9f3324e22dca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca] added
Apr 14 18:47:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159d9ed-683a-4a71-a4af-397c5833df20]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b2c29-41f7-469d-99d7-baba9e73353c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HANrcBMf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HANrcBMf" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[518de2d0-d2e5-416d-8264-14845b2eca0c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HANrcBMf'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[509617e8-1689-4abb-9c07-418bc7d27b96]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8be8c5-6a0c-4ced-8062-af48a21b66c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:27 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:47:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:27 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:47:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04fe38a-9475-4ba8-ac21-bd06a899cf21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca, portal: 172.16.0.220,3260]
Apr 14 18:47:27 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca, portal: 172.16.0.220,3260] successful.
Apr 14 18:47:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec92eb1-5d60-45b0-a722-0867f2e078e8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8167c-c5d8-42da-be94-dc16d9999393]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:27 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:47:27 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:47:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:47:27 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:47:27 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:47:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76cf2c-223d-4ba8-b5c9-79234912ee23]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HANrcBMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:47:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23666363461393564', 'path': '/dev/sdd'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666363461393564', 'path': '/dev/sdd'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ee:9b,bridge_name='br-int',has_traffic_filtering=True,id=6690e4a9-1979-4050-a6cc-b8fb4c413d24,network=Network(7745e31f-d91c-446a-a70a-50c6c684b42b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6690e4a9-19') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:81:04,bridge_name='br-int',has_traffic_filtering=True,id=83687b87-4245-4c8f-9a7e-d18dd00942d3,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83687b87-42') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=d30907fa-2785-4ffe-8552-7221fbff7200,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd30907fa-27') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b2:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e979f27-58d7-4973-b70d-f3ca1c5811c5,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e979f27-58') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1b:50,bridge_name='br-int',has_traffic_filtering=True,id=3e05363d-18d0-4fb0-9c3e-40df44246913,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e05363d-18') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bb:0e,bridge_name='br-int',has_traffic_filtering=True,id=b24d8534-70cf-4575-a8f1-f99b5e48b7db,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24d8534-70') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=85e8f915-2217-47d4-a9a8-74be630b2b10,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e8f915-22') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lazy-loading 'pci_devices' on Instance uuid a3378ec4-364a-4656-ac99-500be9d40749 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:47:28 user nova-compute[71308]:   <uuid>a3378ec4-364a-4656-ac99-500be9d40749</uuid>
Apr 14 18:47:28 user nova-compute[71308]:   <name>instance-0000000a</name>
Apr 14 18:47:28 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:47:28 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:47:28 user nova-compute[71308]:   <metadata>
Apr 14 18:47:28 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:47:28 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:47:28 user nova-compute[71308]:       <nova:name>tempest-device-tagging-server-2139810986</nova:name>
Apr 14 18:47:28 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:47:24</nova:creationTime>
Apr 14 18:47:28 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:47:28 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:47:28 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:47:28 user nova-compute[71308]:       <nova:owner>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:user uuid="d4dc36f0048042929d1230f99e2be306">tempest-TaggedBootDevicesTest-621954698-project-member</nova:user>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:project uuid="72ec916e861d448a853251f522699446">tempest-TaggedBootDevicesTest-621954698</nova:project>
Apr 14 18:47:28 user nova-compute[71308]:       </nova:owner>
Apr 14 18:47:28 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:47:28 user nova-compute[71308]:       <nova:ports>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:port uuid="6690e4a9-1979-4050-a6cc-b8fb4c413d24">
Apr 14 18:47:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 18:47:28 user nova-compute[71308]:         </nova:port>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:port uuid="83687b87-4245-4c8f-9a7e-d18dd00942d3">
Apr 14 18:47:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.1.1.236" ipVersion="4"/>
Apr 14 18:47:28 user nova-compute[71308]:         </nova:port>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:port uuid="d30907fa-2785-4ffe-8552-7221fbff7200">
Apr 14 18:47:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.1.1.20" ipVersion="4"/>
Apr 14 18:47:28 user nova-compute[71308]:         </nova:port>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:port uuid="1e979f27-58d7-4973-b70d-f3ca1c5811c5">
Apr 14 18:47:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.1.1.119" ipVersion="4"/>
Apr 14 18:47:28 user nova-compute[71308]:         </nova:port>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:port uuid="3e05363d-18d0-4fb0-9c3e-40df44246913">
Apr 14 18:47:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.1.1.221" ipVersion="4"/>
Apr 14 18:47:28 user nova-compute[71308]:         </nova:port>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:port uuid="b24d8534-70cf-4575-a8f1-f99b5e48b7db">
Apr 14 18:47:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 18:47:28 user nova-compute[71308]:         </nova:port>
Apr 14 18:47:28 user nova-compute[71308]:         <nova:port uuid="85e8f915-2217-47d4-a9a8-74be630b2b10">
Apr 14 18:47:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 18:47:28 user nova-compute[71308]:         </nova:port>
Apr 14 18:47:28 user nova-compute[71308]:       </nova:ports>
Apr 14 18:47:28 user nova-compute[71308]:     </nova:instance>
Apr 14 18:47:28 user nova-compute[71308]:   </metadata>
Apr 14 18:47:28 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:47:28 user nova-compute[71308]:     <system>
Apr 14 18:47:28 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:47:28 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:47:28 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:47:28 user nova-compute[71308]:       <entry name="serial">a3378ec4-364a-4656-ac99-500be9d40749</entry>
Apr 14 18:47:28 user nova-compute[71308]:       <entry name="uuid">a3378ec4-364a-4656-ac99-500be9d40749</entry>
Apr 14 18:47:28 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:47:28 user nova-compute[71308]:     </system>
Apr 14 18:47:28 user nova-compute[71308]:   </sysinfo>
Apr 14 18:47:28 user nova-compute[71308]:   <os>
Apr 14 18:47:28 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:47:28 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:47:28 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:47:28 user nova-compute[71308]:   </os>
Apr 14 18:47:28 user nova-compute[71308]:   <features>
Apr 14 18:47:28 user nova-compute[71308]:     <acpi/>
Apr 14 18:47:28 user nova-compute[71308]:     <apic/>
Apr 14 18:47:28 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:47:28 user nova-compute[71308]:   </features>
Apr 14 18:47:28 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:47:28 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:47:28 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:47:28 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:47:28 user nova-compute[71308]:   </clock>
Apr 14 18:47:28 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:47:28 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:47:28 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:47:28 user nova-compute[71308]:   </cpu>
Apr 14 18:47:28 user nova-compute[71308]:   <devices>
Apr 14 18:47:28 user nova-compute[71308]:     <disk type="file" device="cdrom">
Apr 14 18:47:28 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 18:47:28 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/a3378ec4-364a-4656-ac99-500be9d40749/disk.config"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="hda" bus="ide"/>
Apr 14 18:47:28 user nova-compute[71308]:     </disk>
Apr 14 18:47:28 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:47:28 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:47:28 user nova-compute[71308]:       <source dev="/dev/sdb"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <serial>0ec2c8d4-acb4-4707-937f-3834d2130019</serial>
Apr 14 18:47:28 user nova-compute[71308]:     </disk>
Apr 14 18:47:28 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:47:28 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:47:28 user nova-compute[71308]:       <source dev="/dev/sdc"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <serial>382a8e93-fd2e-41aa-b8a2-b2458e16c786</serial>
Apr 14 18:47:28 user nova-compute[71308]:     </disk>
Apr 14 18:47:28 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:47:28 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:47:28 user nova-compute[71308]:       <source dev="/dev/sdd"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="vdc" bus="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <serial>330b8b4e-5b68-43de-b1fb-f661060cc9ca</serial>
Apr 14 18:47:28 user nova-compute[71308]:     </disk>
Apr 14 18:47:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:47:28 user nova-compute[71308]:       <mac address="fa:16:3e:f8:ee:9b"/>
Apr 14 18:47:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="tap6690e4a9-19"/>
Apr 14 18:47:28 user nova-compute[71308]:     </interface>
Apr 14 18:47:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:47:28 user nova-compute[71308]:       <mac address="fa:16:3e:c4:81:04"/>
Apr 14 18:47:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="tap83687b87-42"/>
Apr 14 18:47:28 user nova-compute[71308]:     </interface>
Apr 14 18:47:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:47:28 user nova-compute[71308]:       <mac address="fa:16:3e:7e:a9:e0"/>
Apr 14 18:47:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="tapd30907fa-27"/>
Apr 14 18:47:28 user nova-compute[71308]:     </interface>
Apr 14 18:47:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:47:28 user nova-compute[71308]:       <mac address="fa:16:3e:47:b2:fc"/>
Apr 14 18:47:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="tap1e979f27-58"/>
Apr 14 18:47:28 user nova-compute[71308]:     </interface>
Apr 14 18:47:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:47:28 user nova-compute[71308]:       <mac address="fa:16:3e:9e:1b:50"/>
Apr 14 18:47:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="tap3e05363d-18"/>
Apr 14 18:47:28 user nova-compute[71308]:     </interface>
Apr 14 18:47:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:47:28 user nova-compute[71308]:       <mac address="fa:16:3e:e0:bb:0e"/>
Apr 14 18:47:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="tapb24d8534-70"/>
Apr 14 18:47:28 user nova-compute[71308]:     </interface>
Apr 14 18:47:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:47:28 user nova-compute[71308]:       <mac address="fa:16:3e:c4:7d:a8"/>
Apr 14 18:47:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:47:28 user nova-compute[71308]:       <target dev="tap85e8f915-22"/>
Apr 14 18:47:28 user nova-compute[71308]:     </interface>
Apr 14 18:47:28 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:47:28 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/a3378ec4-364a-4656-ac99-500be9d40749/console.log" append="off"/>
Apr 14 18:47:28 user nova-compute[71308]:     </serial>
Apr 14 18:47:28 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:47:28 user nova-compute[71308]:     <video>
Apr 14 18:47:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:47:28 user nova-compute[71308]:     </video>
Apr 14 18:47:28 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:47:28 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:47:28 user nova-compute[71308]:     </rng>
Apr 14 18:47:28 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:47:28 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:47:28 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:47:28 user nova-compute[71308]:     </memballoon>
Apr 14 18:47:28 user nova-compute[71308]:   </devices>
Apr 14 18:47:28 user nova-compute[71308]: </domain>
Apr 14 18:47:28 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ee:9b,bridge_name='br-int',has_traffic_filtering=True,id=6690e4a9-1979-4050-a6cc-b8fb4c413d24,network=Network(7745e31f-d91c-446a-a70a-50c6c684b42b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6690e4a9-19') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ee:9b,bridge_name='br-int',has_traffic_filtering=True,id=6690e4a9-1979-4050-a6cc-b8fb4c413d24,network=Network(7745e31f-d91c-446a-a70a-50c6c684b42b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6690e4a9-19') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6690e4a9-19, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6690e4a9-19, col_values=(('external_ids', {'iface-id': '6690e4a9-1979-4050-a6cc-b8fb4c413d24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:ee:9b', 'vm-uuid': 'a3378ec4-364a-4656-ac99-500be9d40749'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: INFO os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:ee:9b,bridge_name='br-int',has_traffic_filtering=True,id=6690e4a9-1979-4050-a6cc-b8fb4c413d24,network=Network(7745e31f-d91c-446a-a70a-50c6c684b42b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6690e4a9-19')
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:81:04,bridge_name='br-int',has_traffic_filtering=True,id=83687b87-4245-4c8f-9a7e-d18dd00942d3,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83687b87-42') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:81:04,bridge_name='br-int',has_traffic_filtering=True,id=83687b87-4245-4c8f-9a7e-d18dd00942d3,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83687b87-42') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83687b87-42, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83687b87-42, col_values=(('external_ids', {'iface-id': '83687b87-4245-4c8f-9a7e-d18dd00942d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:81:04', 'vm-uuid': 'a3378ec4-364a-4656-ac99-500be9d40749'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: INFO os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:81:04,bridge_name='br-int',has_traffic_filtering=True,id=83687b87-4245-4c8f-9a7e-d18dd00942d3,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83687b87-42')
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=d30907fa-2785-4ffe-8552-7221fbff7200,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd30907fa-27') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=d30907fa-2785-4ffe-8552-7221fbff7200,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd30907fa-27') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd30907fa-27, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd30907fa-27, col_values=(('external_ids', {'iface-id': 'd30907fa-2785-4ffe-8552-7221fbff7200', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:a9:e0', 'vm-uuid': 'a3378ec4-364a-4656-ac99-500be9d40749'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: INFO os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=d30907fa-2785-4ffe-8552-7221fbff7200,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd30907fa-27')
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b2:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e979f27-58d7-4973-b70d-f3ca1c5811c5,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e979f27-58') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b2:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e979f27-58d7-4973-b70d-f3ca1c5811c5,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e979f27-58') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e979f27-58, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e979f27-58, col_values=(('external_ids', {'iface-id': '1e979f27-58d7-4973-b70d-f3ca1c5811c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:b2:fc', 'vm-uuid': 'a3378ec4-364a-4656-ac99-500be9d40749'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: INFO os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b2:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e979f27-58d7-4973-b70d-f3ca1c5811c5,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e979f27-58')
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1b:50,bridge_name='br-int',has_traffic_filtering=True,id=3e05363d-18d0-4fb0-9c3e-40df44246913,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e05363d-18') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1b:50,bridge_name='br-int',has_traffic_filtering=True,id=3e05363d-18d0-4fb0-9c3e-40df44246913,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e05363d-18') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e05363d-18, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e05363d-18, col_values=(('external_ids', {'iface-id': '3e05363d-18d0-4fb0-9c3e-40df44246913', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:1b:50', 'vm-uuid': 'a3378ec4-364a-4656-ac99-500be9d40749'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: INFO os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1b:50,bridge_name='br-int',has_traffic_filtering=True,id=3e05363d-18d0-4fb0-9c3e-40df44246913,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e05363d-18')
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bb:0e,bridge_name='br-int',has_traffic_filtering=True,id=b24d8534-70cf-4575-a8f1-f99b5e48b7db,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24d8534-70') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bb:0e,bridge_name='br-int',has_traffic_filtering=True,id=b24d8534-70cf-4575-a8f1-f99b5e48b7db,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24d8534-70') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb24d8534-70, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb24d8534-70, col_values=(('external_ids', {'iface-id': 'b24d8534-70cf-4575-a8f1-f99b5e48b7db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:bb:0e', 'vm-uuid': 'a3378ec4-364a-4656-ac99-500be9d40749'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: INFO os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bb:0e,bridge_name='br-int',has_traffic_filtering=True,id=b24d8534-70cf-4575-a8f1-f99b5e48b7db,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24d8534-70')
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=85e8f915-2217-47d4-a9a8-74be630b2b10,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e8f915-22') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=85e8f915-2217-47d4-a9a8-74be630b2b10,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e8f915-22') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85e8f915-22, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85e8f915-22, col_values=(('external_ids', {'iface-id': '85e8f915-2217-47d4-a9a8-74be630b2b10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:7d:a8', 'vm-uuid': 'a3378ec4-364a-4656-ac99-500be9d40749'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:47:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:28 user nova-compute[71308]: INFO os_vif [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=85e8f915-2217-47d4-a9a8-74be630b2b10,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e8f915-22')
Apr 14 18:47:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] No BDM found with device name hda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:47:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:47:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] No VIF found with MAC fa:16:3e:f8:ee:9b, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:47:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] No VIF found with MAC fa:16:3e:9e:1b:50, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:47:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Using config drive
Apr 14 18:47:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Creating config drive at /opt/stack/data/nova/instances/a3378ec4-364a-4656-ac99-500be9d40749/disk.config
Apr 14 18:47:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a3378ec4-364a-4656-ac99-500be9d40749/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt35looui {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a3378ec4-364a-4656-ac99-500be9d40749/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt35looui" returned: 0 in 0.057s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:31 user nova-compute[71308]: WARNING nova.compute.manager [req-9eceecd4-1be0-42ba-856c-9802ea38cd70 req-b4598649-59b1-4e0d-9356-592012d176b9 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance with vm_state building and task_state spawning.
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:31 user nova-compute[71308]: WARNING nova.compute.manager [req-a441e8b9-d713-4384-b954-bcaa96a9cc2b req-0e21d089-7eca-45ee-9cb8-93960aba9ae8 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 for instance with vm_state building and task_state spawning.
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:32 user nova-compute[71308]: WARNING nova.compute.manager [req-add7bf06-7f66-489e-a7d9-7c2c9fecf5e4 req-6a909062-b9a6-4b3c-9a5a-a35a9466d5d2 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-3e05363d-18d0-4fb0-9c3e-40df44246913 for instance with vm_state building and task_state spawning.
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:33 user nova-compute[71308]: WARNING nova.compute.manager [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance with vm_state building and task_state spawning.
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:33 user nova-compute[71308]: WARNING nova.compute.manager [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-d30907fa-2785-4ffe-8552-7221fbff7200 for instance with vm_state building and task_state spawning.
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:33 user nova-compute[71308]: WARNING nova.compute.manager [req-5950cee0-4e0e-4c72-a969-c2168efaee37 req-374a1c15-b863-451b-aeeb-61243958b153 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-d30907fa-2785-4ffe-8552-7221fbff7200 for instance with vm_state building and task_state spawning.
Apr 14 18:47:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:33 user nova-compute[71308]: WARNING nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 for instance with vm_state building and task_state spawning.
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:33 user nova-compute[71308]: WARNING nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance with vm_state building and task_state spawning.
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:33 user nova-compute[71308]: WARNING nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance with vm_state building and task_state spawning.
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:33 user nova-compute[71308]: WARNING nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance with vm_state building and task_state spawning.
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:33 user nova-compute[71308]: WARNING nova.compute.manager [req-975b6d52-762e-4f30-9ea1-218bd172be39 req-d027ca3a-2616-4aee-98da-f1b37024cb10 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance with vm_state building and task_state spawning.
Apr 14 18:47:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:34 user nova-compute[71308]: WARNING nova.compute.manager [req-20d3bbe0-5cb4-4fba-a102-6bd9e70e1da1 req-f76574e4-69bf-4447-a158-dd80fa99d231 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-3e05363d-18d0-4fb0-9c3e-40df44246913 for instance with vm_state building and task_state spawning.
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498055.0872178, a3378ec4-364a-4656-ac99-500be9d40749 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:47:35 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] VM Resumed (Lifecycle Event)
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:47:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance spawned successfully.
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:47:35 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498055.0895293, a3378ec4-364a-4656-ac99-500be9d40749 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:47:35 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] VM Started (Lifecycle Event)
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:47:35 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:47:35 user nova-compute[71308]: INFO nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Took 10.91 seconds to spawn the instance on the hypervisor.
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:35 user nova-compute[71308]: INFO nova.compute.manager [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Took 33.30 seconds to build instance.
Apr 14 18:47:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c79707b2-4a5a-4ec8-9ba2-aefc68aabe3b tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "a3378ec4-364a-4656-ac99-500be9d40749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.437s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:35 user nova-compute[71308]: WARNING nova.compute.manager [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-85e8f915-2217-47d4-a9a8-74be630b2b10 for instance with vm_state active and task_state None.
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:47:35 user nova-compute[71308]: WARNING nova.compute.manager [req-872337cc-6e1e-415e-8698-deeaafa382c6 req-16731eef-a351-4591-aeef-4549bf63f2bd service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-85e8f915-2217-47d4-a9a8-74be630b2b10 for instance with vm_state active and task_state None.
Apr 14 18:47:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:47:54 user nova-compute[71308]: INFO nova.compute.manager [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] instance snapshotting
Apr 14 18:47:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Beginning live snapshot process
Apr 14 18:47:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json -f qcow2 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json -f qcow2 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.130s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2j947gv1/4407beb2f48847dab06bf613e87e550d.delta 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2j947gv1/4407beb2f48847dab06bf613e87e550d.delta 1073741824" returned: 0 in 0.046s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 18:47:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71308) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 18:47:54 user nova-compute[71308]: INFO nova.virt.libvirt.host [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] UEFI support detected
Apr 14 18:47:54 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:47:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:47:55 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:47:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:47:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:47:56 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2j947gv1/4407beb2f48847dab06bf613e87e550d.delta /opt/stack/data/nova/instances/snapshots/tmp2j947gv1/4407beb2f48847dab06bf613e87e550d {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2j947gv1/4407beb2f48847dab06bf613e87e550d.delta /opt/stack/data/nova/instances/snapshots/tmp2j947gv1/4407beb2f48847dab06bf613e87e550d" returned: 0 in 0.279s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:56 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Snapshot extracted, beginning image upload
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:58 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Snapshot image upload complete
Apr 14 18:47:58 user nova-compute[71308]: INFO nova.compute.manager [None req-ed7e90a8-23cb-426b-8d3b-1825fc8cc237 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Took 4.82 seconds to snapshot the instance on the hypervisor.
Apr 14 18:47:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:47:59 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:59 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7146MB free_disk=26.56964874267578GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 094a4a33-569e-4137-8798-743499f1046c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 817f112c-d806-4800-9e4a-a3892c54bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance e03adca9-8b0c-416c-943e-7dce251547c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a3378ec4-364a-4656-ac99-500be9d40749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:47:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "849b47d6-c267-420e-bb09-e43e33ad1df1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG nova.objects.instance [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lazy-loading 'flavor' on Instance uuid 849b47d6-c267-420e-bb09-e43e33ad1df1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "849b47d6-c267-420e-bb09-e43e33ad1df1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:00 user nova-compute[71308]: INFO nova.compute.manager [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Attaching volume 92fae690-8b67-45c0-b93c-b2915ea3a57e to /dev/vdb
Apr 14 18:48:00 user nova-compute[71308]: DEBUG os_brick.utils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a916f5-534b-453d-8bfc-4f4995353103]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce16a7b-31dd-42d5-986c-2b2325894146]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[77856a59-2aee-4734-b452-a42a6ca4b44f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1bf58f-1fad-4825-bb40-1a4f4d71cce4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:00 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:48:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4b401f-8239-45f8-8796-8a62c78c6637]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG os_brick.utils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:00 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Updating existing volume attachment record: ac7b32ec-968a-4be1-a496-be0a9b2b6173 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received event network-changed-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Refreshing instance network info cache due to event network-changed-940c6edd-6fc7-4e88-92b4-38a62e88f2ab. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] Acquiring lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] Acquired lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG nova.network.neutron [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Refreshing network info cache for port 940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-849b47d6-c267-420e-bb09-e43e33ad1df1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-849b47d6-c267-420e-bb09-e43e33ad1df1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:01 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG nova.network.neutron [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Updated VIF entry in instance network info cache for port 940c6edd-6fc7-4e88-92b4-38a62e88f2ab. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG nova.network.neutron [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Updating instance_info_cache with network_info: [{"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-edfcb1db-7f56-4b7d-a556-f732cfb00131 req-6237ba71-adea-46f4-8f71-8a9bf1bb8f7a service nova] Releasing lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Updating instance_info_cache with network_info: [{"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-849b47d6-c267-420e-bb09-e43e33ad1df1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:48:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-changed-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Refreshing instance network info cache due to event network-changed-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] Acquiring lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] Acquired lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:03 user nova-compute[71308]: DEBUG nova.network.neutron [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Refreshing network info cache for port 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'flavor' on Instance uuid 094a4a33-569e-4137-8798-743499f1046c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG nova.network.neutron [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updated VIF entry in instance network info cache for port 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG nova.network.neutron [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating instance_info_cache with network_info: [{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4b9aa67c-92a7-4547-a2d9-f8f9aef02f58 req-348a5973-4e3a-420c-b71d-dcbef5978180 service nova] Releasing lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:04 user nova-compute[71308]: INFO nova.compute.manager [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Attaching volume 8000d5a4-c39b-41b5-a47c-0f83b55fa0ab to /dev/vdb
Apr 14 18:48:04 user nova-compute[71308]: DEBUG os_brick.utils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b921887b-058b-4383-984c-813ccd95d874]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d005024c-c638-4660-ad99-35af7c5389d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f419998f-3975-43f6-861a-89e1bb26d072]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3b214e-a479-4631-ba2c-730214e23266]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:04 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:48:04 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9024b2af-e216-4bcb-bf6c-1f7f86ad5cee]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG os_brick.utils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Updating existing volume attachment record: 6d6f2d7e-87fd-4670-a099-8ace12eb85b1 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:48:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:48:04 user nova-compute[71308]: INFO nova.compute.manager [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] instance snapshotting
Apr 14 18:48:04 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Beginning live snapshot process
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json -f qcow2 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json -f qcow2" returned: 0 in 0.163s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json -f qcow2 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfvtlLxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:05 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:05 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:05 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6g5zevnm/fc250c399ac647889bfa8920cad894a8.delta 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be845a8-c734-41fd-983b-afe16a5b39cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:48:05 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6g5zevnm/fc250c399ac647889bfa8920cad894a8.delta 1073741824" returned: 0 in 0.054s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3ba138-3ae1-453c-8b31-a0e482747b15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e] added
Apr 14 18:48:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[72207783-7467-4e66-8ab5-d5cec468df0e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[292bad8a-03a4-4982-b92b-6e522ca70b7c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfvtlLxa {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfvtlLxa" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9f7b3e-e38a-40df-925a-864a9453037e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WfvtlLxa'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f6e51-8aab-42ed-96b4-a8a2ac53d0c5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e504e689-d185-46d7-bbea-7cd9661ab44f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cbdf77-30a8-42f4-8287-8c00972a76ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e, portal: 172.16.0.220,3260]
Apr 14 18:48:05 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bfc40e-278f-47a5-b8ee-2c43687f7840]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39dbbf9-7f45-4484-8af7-2c35e2b94942]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e (non-flash)
Apr 14 18:48:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:05 user nova-compute[71308]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e (non-flash)
Apr 14 18:48:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0be209-89cb-4bc4-90e7-909865bcc89d]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfvtlLxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.compute.manager [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-changed-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.compute.manager [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Refreshing instance network info cache due to event network-changed-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] Acquiring lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] Acquired lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.network.neutron [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Refreshing network info cache for port 2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:06 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 18:48:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23135626234383839', 'path': '/dev/sde'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135626234383839', 'path': '/dev/sde'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.objects.instance [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lazy-loading 'flavor' on Instance uuid 849b47d6-c267-420e-bb09-e43e33ad1df1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.network.neutron [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updated VIF entry in instance network info cache for port 2afe22e1-0044-47e2-ba5f-e1d9fd6d0620. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.network.neutron [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7976fb39-5a9d-4dd2-8a26-0df3e543c265 req-a0145900-5a68-49e7-b4b2-49b1dfb58c16 service nova] Releasing lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6g5zevnm/fc250c399ac647889bfa8920cad894a8.delta /opt/stack/data/nova/instances/snapshots/tmp6g5zevnm/fc250c399ac647889bfa8920cad894a8 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:48:06 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:06 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:48:06 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:48:06 user nova-compute[71308]:   <serial>92fae690-8b67-45c0-b93c-b2915ea3a57e</serial>
Apr 14 18:48:06 user nova-compute[71308]: </disk>
Apr 14 18:48:06 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:48:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6g5zevnm/fc250c399ac647889bfa8920cad894a8.delta /opt/stack/data/nova/instances/snapshots/tmp6g5zevnm/fc250c399ac647889bfa8920cad894a8" returned: 0 in 0.488s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:07 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Snapshot extracted, beginning image upload
Apr 14 18:48:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] No VIF found with MAC fa:16:3e:0d:be:20, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:48:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-252e81c1-b0b9-419c-bccf-71613eefe077 tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.201s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "849b47d6-c267-420e-bb09-e43e33ad1df1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:08 user nova-compute[71308]: INFO nova.compute.manager [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Terminating instance
Apr 14 18:48:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received event network-vif-unplugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] Acquiring lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] No waiting events found dispatching network-vif-unplugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-3d4ee332-5c52-40cd-a7b6-5aa428e38850 req-e48b2378-2f5f-4346-8621-039b5c036228 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received event network-vif-unplugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Instance destroyed successfully.
Apr 14 18:48:09 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lazy-loading 'resources' on Instance uuid 849b47d6-c267-420e-bb09-e43e33ad1df1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-359661015',display_name='tempest-DeleteServersTestJSON-server-359661015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-359661015',id=2,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04f259dc787d468596879969e33f2e62',ramdisk_id='',reservation_id='r-f6uf2f9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1432237973',owner_user_name='tempest-DeleteServersTestJSON-1432237973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:24Z,user_data=None,user_id='3a860138cfc74444a78dc1e456a9d67f',uuid=849b47d6-c267-420e-bb09-e43e33ad1df1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Converting VIF {"id": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "address": "fa:16:3e:0d:be:20", "network": {"id": "03b497b2-e5c6-4d9a-83e2-7ddf38428b4c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-137839211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04f259dc787d468596879969e33f2e62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29b77a39-c2", "ovs_interfaceid": "29b77a39-c2df-45c1-83ea-72ffe0a24460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:be:20,bridge_name='br-int',has_traffic_filtering=True,id=29b77a39-c2df-45c1-83ea-72ffe0a24460,network=Network(03b497b2-e5c6-4d9a-83e2-7ddf38428b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b77a39-c2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_vif [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:be:20,bridge_name='br-int',has_traffic_filtering=True,id=29b77a39-c2df-45c1-83ea-72ffe0a24460,network=Network(03b497b2-e5c6-4d9a-83e2-7ddf38428b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b77a39-c2') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29b77a39-c2, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:09 user nova-compute[71308]: INFO os_vif [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:be:20,bridge_name='br-int',has_traffic_filtering=True,id=29b77a39-c2df-45c1-83ea-72ffe0a24460,network=Network(03b497b2-e5c6-4d9a-83e2-7ddf38428b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29b77a39-c2')
Apr 14 18:48:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfvtlLxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:09 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[677df337-b027-4f6c-bfee-d18f2b39fbd7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:48:09 user nova-compute[71308]: No targets found.
Apr 14 18:48:09 user nova-compute[71308]: iSNS:
Apr 14 18:48:09 user nova-compute[71308]: No targets found.
Apr 14 18:48:09 user nova-compute[71308]: STATIC:
Apr 14 18:48:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e
Apr 14 18:48:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca
Apr 14 18:48:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786
Apr 14 18:48:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019
Apr 14 18:48:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:09 user nova-compute[71308]: FIRMWARE:
Apr 14 18:48:09 user nova-compute[71308]: No targets found.
Apr 14 18:48:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:48:09 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:48:09 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b708772-65d4-4608-80e3-9fe3da989315]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da7779-d4bb-4c21-8b07-49283bb57c0c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e (non-flash)
Apr 14 18:48:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e (non-flash)
Apr 14 18:48:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aae2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e'): ({'sde'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Removing single pathed devices sde {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[721f7d77-19c1-48dd-a5d2-a814f60a946c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[314a005a-fbbc-4eca-9339-2154ac1ea543]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Flushing IO for device /dev/sde {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6165c4-90e0-4db7-9318-68440fb76e68]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d27c3c6-beda-4dbd-9157-b3d9081bebe7]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.105s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc8b654-f731-4612-9937-169b75d3b8c0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --logout" returned: 0 in 0.144s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a809697-d7e7-429c-a3dd-b65453498f95]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e, portal: 172.16.0.220,3260]
Apr 14 18:48:09 user nova-compute[71308]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92fae690-8b67-45c0-b93c-b2915ea3a57e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[863c6cc5-6db2-427c-97e3-a9470d8fd228]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] <== disconnect_volume: return (482ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:48:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Deleting instance files /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1_del
Apr 14 18:48:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Deletion of /opt/stack/data/nova/instances/849b47d6-c267-420e-bb09-e43e33ad1df1_del complete
Apr 14 18:48:09 user nova-compute[71308]: INFO nova.compute.manager [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Took 1.39 seconds to destroy the instance on the hypervisor.
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdYiDytN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:09 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:09 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:09 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ff821c-6573-465c-a90d-14579ad439bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:48:09 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb2278-275c-4d34-8d22-402b9e27f0fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab] added
Apr 14 18:48:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0039b1-4ff8-4c20-90be-600dfaf986ba]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27f7d75-27a9-4875-8421-6bf7f69f9e40]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdYiDytN {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdYiDytN" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e28c2a-030f-4dcb-9787-6c5008603b44]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZdYiDytN'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2971a9-3c49-4806-8f3e-6f426a25da70]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd277da-983f-4237-93a8-23048448a069]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:09 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad532497-84cf-4748-9819-9772bf1054ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab, portal: 172.16.0.220,3260]
Apr 14 18:48:09 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5502f561-726e-4df1-9863-8e037b3985f5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb2444-11cd-42a7-aebd-0142c11b5e14]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:10 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:10 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:10 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:10 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:10 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:10 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c6f078-4423-4590-b84d-57b902445a74]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdYiDytN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:48:10 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Snapshot image upload complete
Apr 14 18:48:10 user nova-compute[71308]: INFO nova.compute.manager [None req-353b7022-6edb-44af-9fb9-add5696a9fd0 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Took 5.35 seconds to snapshot the instance on the hypervisor.
Apr 14 18:48:10 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:10 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Took 0.72 seconds to deallocate network for instance.
Apr 14 18:48:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received event network-vif-deleted-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:10 user nova-compute[71308]: INFO nova.compute.manager [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Neutron deleted interface 29b77a39-c2df-45c1-83ea-72ffe0a24460; detaching it from the instance and deleting it from the info cache
Apr 14 18:48:10 user nova-compute[71308]: DEBUG nova.network.neutron [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-56cf62b0-84d3-4afb-ba74-d9d171c23f88 req-09e8bb10-4d11-49c2-b5eb-6664d91c5a04 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Detach interface failed, port_id=29b77a39-c2df-45c1-83ea-72ffe0a24460, reason: Instance 849b47d6-c267-420e-bb09-e43e33ad1df1 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received event network-vif-plugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] Acquiring lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] No waiting events found dispatching network-vif-plugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:10 user nova-compute[71308]: WARNING nova.compute.manager [req-92c8f3e9-e25c-4921-9bea-cbfb85bc41d5 req-a32702ca-4f28-44a0-9666-76dd1bf594c4 service nova] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Received unexpected event network-vif-plugged-29b77a39-c2df-45c1-83ea-72ffe0a24460 for instance with vm_state active and task_state deleting.
Apr 14 18:48:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26130346561303131', 'path': '/dev/sde'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130346561303131', 'path': '/dev/sde'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'flavor' on Instance uuid 094a4a33-569e-4137-8798-743499f1046c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:48:11 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:11 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:48:11 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:48:11 user nova-compute[71308]:   <serial>8000d5a4-c39b-41b5-a47c-0f83b55fa0ab</serial>
Apr 14 18:48:11 user nova-compute[71308]: </disk>
Apr 14 18:48:11 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:48:11 user nova-compute[71308]: INFO nova.compute.manager [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Took 0.78 seconds to detach 1 volumes for instance.
Apr 14 18:48:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No VIF found with MAC fa:16:3e:84:f7:b1, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:11 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Deleted allocations for instance 849b47d6-c267-420e-bb09-e43e33ad1df1
Apr 14 18:48:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ee65c5c5-4320-447c-b890-ab5c401a2309 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.140s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7008e292-d713-4cc6-8fdc-30b67a2f0bcd tempest-DeleteServersTestJSON-1432237973 tempest-DeleteServersTestJSON-1432237973-project-member] Lock "849b47d6-c267-420e-bb09-e43e33ad1df1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.467s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:48:15 user nova-compute[71308]: INFO nova.compute.claims [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Claim successful on node user
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:48:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.policy [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:48:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Creating image(s)
Apr 14 18:48:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "/opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "/opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.024s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.130s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk 1073741824" returned: 0 in 0.051s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.129s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Successfully created port: c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Cannot resize image /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'migration_context' on Instance uuid a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Ensure instance console log exists: /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Successfully updated port: c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "refresh_cache-a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquired lock "refresh_cache-a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received event network-changed-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Refreshing instance network info cache due to event network-changed-c5adcd6e-6277-40d5-8d78-4df9155319ba. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] Acquiring lock "refresh_cache-a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Updating instance_info_cache with network_info: [{"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Releasing lock "refresh_cache-a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Instance network_info: |[{"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] Acquired lock "refresh_cache-a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.network.neutron [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Refreshing network info cache for port c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Start _get_guest_xml network_info=[{"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:48:17 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:48:17 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1130291892',display_name='tempest-AttachVolumeNegativeTest-server-1130291892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1130291892',id=13,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv5tcWUysgHNjqS8vIJY6wuxptnW7SVWtpF8Vm4ifl+8f/mUTKLgZGllDwY5TPms5tlvjb7AnrxpIcD8irOHwpoEkzOiACF26K/c654rXUweH7qfR4k/mAAGTe7KExSjg==',key_name='tempest-keypair-1533000139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-yiisqxs4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5adcd6e-6277-40d5-8d78-4df9155319ba,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5adcd6e-62') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'pci_devices' on Instance uuid a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:48:17 user nova-compute[71308]:   <uuid>a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9</uuid>
Apr 14 18:48:17 user nova-compute[71308]:   <name>instance-0000000d</name>
Apr 14 18:48:17 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:48:17 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:48:17 user nova-compute[71308]:   <metadata>
Apr 14 18:48:17 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:48:17 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:48:17 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1130291892</nova:name>
Apr 14 18:48:17 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:48:17</nova:creationTime>
Apr 14 18:48:17 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:48:17 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:48:17 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:48:17 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:48:17 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:48:17 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:48:17 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:48:17 user nova-compute[71308]:       <nova:owner>
Apr 14 18:48:17 user nova-compute[71308]:         <nova:user uuid="8d53edaffb8f4038abd366d7942c6bc7">tempest-AttachVolumeNegativeTest-1648028886-project-member</nova:user>
Apr 14 18:48:17 user nova-compute[71308]:         <nova:project uuid="e34cdebcd7154988a957deae140e8eab">tempest-AttachVolumeNegativeTest-1648028886</nova:project>
Apr 14 18:48:17 user nova-compute[71308]:       </nova:owner>
Apr 14 18:48:17 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:48:17 user nova-compute[71308]:       <nova:ports>
Apr 14 18:48:17 user nova-compute[71308]:         <nova:port uuid="c5adcd6e-6277-40d5-8d78-4df9155319ba">
Apr 14 18:48:17 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 18:48:17 user nova-compute[71308]:         </nova:port>
Apr 14 18:48:17 user nova-compute[71308]:       </nova:ports>
Apr 14 18:48:17 user nova-compute[71308]:     </nova:instance>
Apr 14 18:48:17 user nova-compute[71308]:   </metadata>
Apr 14 18:48:17 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:48:17 user nova-compute[71308]:     <system>
Apr 14 18:48:17 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:48:17 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:48:17 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:48:17 user nova-compute[71308]:       <entry name="serial">a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9</entry>
Apr 14 18:48:17 user nova-compute[71308]:       <entry name="uuid">a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9</entry>
Apr 14 18:48:17 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:48:17 user nova-compute[71308]:     </system>
Apr 14 18:48:17 user nova-compute[71308]:   </sysinfo>
Apr 14 18:48:17 user nova-compute[71308]:   <os>
Apr 14 18:48:17 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:48:17 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:48:17 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:48:17 user nova-compute[71308]:   </os>
Apr 14 18:48:17 user nova-compute[71308]:   <features>
Apr 14 18:48:17 user nova-compute[71308]:     <acpi/>
Apr 14 18:48:17 user nova-compute[71308]:     <apic/>
Apr 14 18:48:17 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:48:17 user nova-compute[71308]:   </features>
Apr 14 18:48:17 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:48:17 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:48:17 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:48:17 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:48:17 user nova-compute[71308]:   </clock>
Apr 14 18:48:17 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:48:17 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:48:17 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:48:17 user nova-compute[71308]:   </cpu>
Apr 14 18:48:17 user nova-compute[71308]:   <devices>
Apr 14 18:48:17 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:48:17 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:48:17 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk"/>
Apr 14 18:48:17 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:48:17 user nova-compute[71308]:     </disk>
Apr 14 18:48:17 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:48:17 user nova-compute[71308]:       <mac address="fa:16:3e:b9:55:d5"/>
Apr 14 18:48:17 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:48:17 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:48:17 user nova-compute[71308]:       <target dev="tapc5adcd6e-62"/>
Apr 14 18:48:17 user nova-compute[71308]:     </interface>
Apr 14 18:48:17 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:48:17 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/console.log" append="off"/>
Apr 14 18:48:17 user nova-compute[71308]:     </serial>
Apr 14 18:48:17 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:48:17 user nova-compute[71308]:     <video>
Apr 14 18:48:17 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:48:17 user nova-compute[71308]:     </video>
Apr 14 18:48:17 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:48:17 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:48:17 user nova-compute[71308]:     </rng>
Apr 14 18:48:17 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:48:17 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:48:17 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:48:17 user nova-compute[71308]:     </memballoon>
Apr 14 18:48:17 user nova-compute[71308]:   </devices>
Apr 14 18:48:17 user nova-compute[71308]: </domain>
Apr 14 18:48:17 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1130291892',display_name='tempest-AttachVolumeNegativeTest-server-1130291892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1130291892',id=13,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv5tcWUysgHNjqS8vIJY6wuxptnW7SVWtpF8Vm4ifl+8f/mUTKLgZGllDwY5TPms5tlvjb7AnrxpIcD8irOHwpoEkzOiACF26K/c654rXUweH7qfR4k/mAAGTe7KExSjg==',key_name='tempest-keypair-1533000139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-yiisqxs4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5adcd6e-6277-40d5-8d78-4df9155319ba,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5adcd6e-62') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG os_vif [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5adcd6e-6277-40d5-8d78-4df9155319ba,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5adcd6e-62') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5adcd6e-62, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5adcd6e-62, col_values=(('external_ids', {'iface-id': 'c5adcd6e-6277-40d5-8d78-4df9155319ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:55:d5', 'vm-uuid': 'a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:17 user nova-compute[71308]: INFO os_vif [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5adcd6e-6277-40d5-8d78-4df9155319ba,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5adcd6e-62')
Apr 14 18:48:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No VIF found with MAC fa:16:3e:b9:55:d5, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:48:18 user nova-compute[71308]: DEBUG nova.network.neutron [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Updated VIF entry in instance network info cache for port c5adcd6e-6277-40d5-8d78-4df9155319ba. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:18 user nova-compute[71308]: DEBUG nova.network.neutron [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Updating instance_info_cache with network_info: [{"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4981946f-dae8-402f-9b0d-c509486df16f req-71e5768b-74a6-45f3-98dd-9f5ed4d2cb2e service nova] Releasing lock "refresh_cache-a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received event network-vif-plugged-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] Acquiring lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] No waiting events found dispatching network-vif-plugged-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:19 user nova-compute[71308]: WARNING nova.compute.manager [req-98318ef7-a9fb-48c4-86db-57c2fbf11478 req-fd18832a-44b7-4e29-81ba-55d050c7716d service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received unexpected event network-vif-plugged-c5adcd6e-6277-40d5-8d78-4df9155319ba for instance with vm_state building and task_state spawning.
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498101.2937756, a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:48:21 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] VM Resumed (Lifecycle Event)
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:48:21 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Instance spawned successfully.
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:48:21 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498101.298082, a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:48:21 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] VM Started (Lifecycle Event)
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:48:21 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:48:21 user nova-compute[71308]: INFO nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Took 5.49 seconds to spawn the instance on the hypervisor.
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:48:21 user nova-compute[71308]: INFO nova.compute.manager [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Took 6.26 seconds to build instance.
Apr 14 18:48:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d156666e-bf89-4d81-b813-a89de8bb194f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.356s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received event network-vif-plugged-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] Acquiring lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] No waiting events found dispatching network-vif-plugged-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:21 user nova-compute[71308]: WARNING nova.compute.manager [req-7aef9ef7-28bd-43c9-ae22-bef5e47fe25a req-385050bb-3f35-43fa-b9a1-a57250223829 service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received unexpected event network-vif-plugged-c5adcd6e-6277-40d5-8d78-4df9155319ba for instance with vm_state active and task_state None.
Apr 14 18:48:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:24 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498089.020944, 849b47d6-c267-420e-bb09-e43e33ad1df1 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:48:24 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] VM Stopped (Lifecycle Event)
Apr 14 18:48:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-6d759e5e-724e-49e1-ae9a-cb8fccc5623c None None] [instance: 849b47d6-c267-420e-bb09-e43e33ad1df1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:48:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received event network-changed-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Refreshing instance network info cache due to event network-changed-4a744ab3-b516-4349-adfd-98d2ce4332d2. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] Acquiring lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] Acquired lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:27 user nova-compute[71308]: DEBUG nova.network.neutron [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Refreshing network info cache for port 4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Updated VIF entry in instance network info cache for port 4a744ab3-b516-4349-adfd-98d2ce4332d2. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Updating instance_info_cache with network_info: [{"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-40f0dad3-1849-451b-8660-3a53cab7256c req-413c9e7a-5447-421f-9ed0-16672ead3c2e service nova] Releasing lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received event network-changed-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Refreshing instance network info cache due to event network-changed-51aafe60-87de-4ca9-8168-cbac2aeb557e. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] Acquiring lock "refresh_cache-499df49b-4a00-447b-bd2f-b027fb44f3b8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] Acquired lock "refresh_cache-499df49b-4a00-447b-bd2f-b027fb44f3b8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Refreshing network info cache for port 51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Updated VIF entry in instance network info cache for port 51aafe60-87de-4ca9-8168-cbac2aeb557e. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Updating instance_info_cache with network_info: [{"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ba314f88-f6f3-4675-a0f8-9cf47b43a0c7 req-6f39b401-8f9b-4704-a7d3-40ec2c15182f service nova] Releasing lock "refresh_cache-499df49b-4a00-447b-bd2f-b027fb44f3b8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'flavor' on Instance uuid 817f112c-d806-4800-9e4a-a3892c54bee1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.158s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:30 user nova-compute[71308]: INFO nova.compute.manager [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Attaching volume 3b3d213e-10a2-47c2-a13e-96b4c199d198 to /dev/vdb
Apr 14 18:48:30 user nova-compute[71308]: DEBUG os_brick.utils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b71296-bdff-488f-9132-72ec47aae15e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[13895c40-abc6-4915-aeed-6b954ff87664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf620b2-bd4e-4f3d-a9d2-4eb9c1b9eb4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[18918bfd-c039-4c03-8cb6-a38bb1a913b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:30 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:48:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc58224f-f83e-437f-9f4d-4b135baedebf]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG os_brick.utils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:30 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Updating existing volume attachment record: c9ead973-da0c-4568-afe3-9e4116b31f03 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:48:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:31 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lazy-loading 'flavor' on Instance uuid 499df49b-4a00-447b-bd2f-b027fb44f3b8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:32 user nova-compute[71308]: INFO nova.compute.manager [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Attaching volume d9925aa7-e3bf-4bff-ac58-d534eae3beea to /dev/sdc
Apr 14 18:48:32 user nova-compute[71308]: DEBUG os_brick.utils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[041930ab-a0fe-466b-9b16-f557f827d658]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc297d5-4dcc-481c-aed6-d4eac3e53235]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f41dfa-2122-48fa-9d85-feaeeff97995]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f41a55-c631-490f-9c37-cf73131b8fea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:32 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:48:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ebf17-f830-4260-9b92-10b961777c12]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG os_brick.utils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Updating existing volume attachment record: 8c32cdb9-fd8c-4de2-aa70-d41a694b8453 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVlfLJYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:35 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:35 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:35 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac557cd1-5e3e-4e5a-9395-6f478c5ee54f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:48:35 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6095e8db-89ca-4652-b917-ad3377e74d2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198] added
Apr 14 18:48:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[686e98e7-b41c-437a-b809-71404d9816aa]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c96447c-9868-4c7f-ba9b-67dcfd49d3a8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVlfLJYv {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVlfLJYv" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4878cc-e029-4d98-8f4b-d37f234665bf]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xVlfLJYv'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cac6690-825e-47b8-9b6a-d2f969f50c38]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab9a64-6053-44f8-ae8c-4da6e9a3de5e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:35 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:35 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:35 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:35 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:35 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:35 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47a7e7-c302-4bd7-aa01-b85409de2aba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198, portal: 172.16.0.220,3260]
Apr 14 18:48:36 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:36 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb60d6-a11f-475f-9104-c12061669e30]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5648055c-9efd-4504-a54e-1f868f627b1f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:36 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:36 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:36 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:36 user nova-compute[71308]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)
Apr 14 18:48:36 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:36 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:36 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:36 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:36 user nova-compute[71308]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)
Apr 14 18:48:36 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43f23b8-4521-49da-b64d-2555ab0759f8]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVlfLJYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG nova.compute.manager [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-changed-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG nova.compute.manager [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Refreshing instance network info cache due to event network-changed-a23ae571-1be9-4877-b629-567eb9c62b9d. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] Acquiring lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] Acquired lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:36 user nova-compute[71308]: DEBUG nova.network.neutron [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Refreshing network info cache for port a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NycVpzjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:37 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23639626136646331', 'path': '/dev/sdf'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639626136646331', 'path': '/dev/sdf'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.164s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:37 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:37 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'flavor' on Instance uuid 817f112c-d806-4800-9e4a-a3892c54bee1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1715a3a-e053-4114-b6ac-82c9402aed9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:48:37 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:48:37 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:37 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:48:37 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:48:37 user nova-compute[71308]:   <serial>3b3d213e-10a2-47c2-a13e-96b4c199d198</serial>
Apr 14 18:48:37 user nova-compute[71308]: </disk>
Apr 14 18:48:37 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6183c95c-e0f9-48d3-a6e7-fd50e0dbe303]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea] added
Apr 14 18:48:37 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c217b35e-7705-4afd-992c-c448cca5cc3e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbaf40c-c29c-4c78-8da3-ff2cee09f5c1]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NycVpzjH {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NycVpzjH" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca48a4a0-8cca-4988-b249-ed24e9a82efc]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NycVpzjH'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[475be91e-8e51-48ac-8297-b477a5ad3777]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[75708b2f-2816-4aa4-9b0d-9f35f3eaf608]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[756488a3-872c-4e74-a372-f5b7d3ac0496]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea, portal: 172.16.0.220,3260]
Apr 14 18:48:37 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:37 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[13804f75-d07d-460e-9137-a3122503be2e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d608f202-e436-46ac-a19a-ea2b7f50c769]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea (non-flash)
Apr 14 18:48:37 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)
Apr 14 18:48:37 user nova-compute[71308]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea (non-flash)
Apr 14 18:48:37 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[088f3448-1a84-4611-8d4d-01aab26d19f8]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NycVpzjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "interface-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "interface-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG nova.objects.instance [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'flavor' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] No VIF found with MAC fa:16:3e:12:88:ee, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8a49244c-c5a3-429d-a8d0-5cf5f9ded300 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.208s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG nova.objects.instance [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'pci_requests' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG nova.policy [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b083d961ab7546a7bb743d034c5e0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efae74f239e14c29b3af28c7fceee94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updated VIF entry in instance network info cache for port a23ae571-1be9-4877-b629-567eb9c62b9d. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updating instance_info_cache with network_info: [{"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-69855225-cef3-4527-91c5-3a8e4620ef73 req-e1f01f39-fd1e-4e3c-a0ab-d682383899b8 service nova] Releasing lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] <== connect_volume: return (1566ms) {'type': 'block', 'scsi_wwn': '23065303061353162', 'path': '/dev/sdg'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065303061353162', 'path': '/dev/sdg'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lazy-loading 'flavor' on Instance uuid 499df49b-4a00-447b-bd2f-b027fb44f3b8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:48:38 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:38 user nova-compute[71308]:   <source dev="/dev/sdg"/>
Apr 14 18:48:38 user nova-compute[71308]:   <target dev="sdc" bus="scsi"/>
Apr 14 18:48:38 user nova-compute[71308]:   <serial>d9925aa7-e3bf-4bff-ac58-d534eae3beea</serial>
Apr 14 18:48:38 user nova-compute[71308]:   <address type="drive" controller="0" unit="2"/>
Apr 14 18:48:38 user nova-compute[71308]: </disk>
Apr 14 18:48:38 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:48:38 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Successfully created port: 29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] No BDM found with device name sda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] No VIF found with MAC fa:16:3e:fb:94:e2, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:39 user nova-compute[71308]: INFO nova.compute.manager [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Detaching volume 3b3d213e-10a2-47c2-a13e-96b4c199d198
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8405445-c5ca-48dc-8933-37f687b5ace5 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.144s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:39 user nova-compute[71308]: INFO nova.virt.block_device [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Attempting to driver detach volume 3b3d213e-10a2-47c2-a13e-96b4c199d198 from mountpoint /dev/vdb
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Attempting to detach device vdb from instance 817f112c-d806-4800-9e4a-a3892c54bee1 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:48:39 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:39 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:48:39 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:48:39 user nova-compute[71308]:   <serial>3b3d213e-10a2-47c2-a13e-96b4c199d198</serial>
Apr 14 18:48:39 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:48:39 user nova-compute[71308]: </disk>
Apr 14 18:48:39 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:48:39 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Successfully detached device vdb from instance 817f112c-d806-4800-9e4a-a3892c54bee1 from the persistent domain config.
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 817f112c-d806-4800-9e4a-a3892c54bee1 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:48:39 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:39 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:48:39 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:48:39 user nova-compute[71308]:   <serial>3b3d213e-10a2-47c2-a13e-96b4c199d198</serial>
Apr 14 18:48:39 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:48:39 user nova-compute[71308]: </disk>
Apr 14 18:48:39 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Successfully updated port: 29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquired lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.compute.manager [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-changed-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.compute.manager [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Refreshing instance network info cache due to event network-changed-29934039-40ef-4f75-a712-55b7ab72c0b0. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] Acquiring lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498119.8803978, 817f112c-d806-4800-9e4a-a3892c54bee1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 817f112c-d806-4800-9e4a-a3892c54bee1 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:48:39 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Successfully detached device vdb from instance 817f112c-d806-4800-9e4a-a3892c54bee1 from the live domain config.
Apr 14 18:48:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVlfLJYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:39 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5b5097-f94e-4a25-840f-2414b796a6f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:48:39 user nova-compute[71308]: No targets found.
Apr 14 18:48:39 user nova-compute[71308]: iSNS:
Apr 14 18:48:39 user nova-compute[71308]: No targets found.
Apr 14 18:48:39 user nova-compute[71308]: STATIC:
Apr 14 18:48:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca
Apr 14 18:48:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786
Apr 14 18:48:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea
Apr 14 18:48:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019
Apr 14 18:48:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:48:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198
Apr 14 18:48:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:39 user nova-compute[71308]: FIRMWARE:
Apr 14 18:48:39 user nova-compute[71308]: No targets found.
Apr 14 18:48:39 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:48:39 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:48:39 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c56947-b0ea-4b2a-a050-4911ea802c63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86ac0f1-8c2f-4002-b088-4e8c77b5b960]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea (non-flash)
Apr 14 18:48:39 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 (non-flash)
Apr 14 18:48:39 user nova-compute[71308]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea (non-flash)
Apr 14 18:48:39 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22752a4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198'): ({'sdf'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Removing single pathed devices sdf {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:48:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e77650-ff8a-4d19-9965-6925f1dbea17]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f95c43f-2edf-4187-b9f6-911015cc6784]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Flushing IO for device /dev/sdf {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received event network-changed-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Refreshing instance network info cache due to event network-changed-fd4a0af3-b371-4b85-8a45-3b68d9884358. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] Acquiring lock "refresh_cache-e03adca9-8b0c-416c-943e-7dce251547c6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] Acquired lock "refresh_cache-e03adca9-8b0c-416c-943e-7dce251547c6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.network.neutron [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Refreshing network info cache for port fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf13f75-cd52-4327-a459-b5dae1c1b6d9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a5ccba-5a36-41df-be53-69f6ee38d2dd]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: INFO nova.compute.manager [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Detaching volume d9925aa7-e3bf-4bff-ac58-d534eae3beea
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb5b65f-30fa-405a-a1a1-6d1aadc332ab]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.objects.instance [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lazy-loading 'flavor' on Instance uuid e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:40 user nova-compute[71308]: INFO nova.virt.block_device [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Attempting to driver detach volume d9925aa7-e3bf-4bff-ac58-d534eae3beea from mountpoint /dev/sdc
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Attempting to detach device sdc from instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:48:40 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:40 user nova-compute[71308]:   <source dev="/dev/sdg"/>
Apr 14 18:48:40 user nova-compute[71308]:   <target dev="sdc" bus="scsi"/>
Apr 14 18:48:40 user nova-compute[71308]:   <serial>d9925aa7-e3bf-4bff-ac58-d534eae3beea</serial>
Apr 14 18:48:40 user nova-compute[71308]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 18:48:40 user nova-compute[71308]: </disk>
Apr 14 18:48:40 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24164e8-0353-4f58-a33d-4b1b4f0b2f15]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198, portal: 172.16.0.220,3260]
Apr 14 18:48:40 user nova-compute[71308]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:40 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Successfully detached device sdc from instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 from the persistent domain config.
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:48:40 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:40 user nova-compute[71308]:   <source dev="/dev/sdg"/>
Apr 14 18:48:40 user nova-compute[71308]:   <target dev="sdc" bus="scsi"/>
Apr 14 18:48:40 user nova-compute[71308]:   <serial>d9925aa7-e3bf-4bff-ac58-d534eae3beea</serial>
Apr 14 18:48:40 user nova-compute[71308]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 18:48:40 user nova-compute[71308]: </disk>
Apr 14 18:48:40 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b3d213e-10a2-47c2-a13e-96b4c199d198 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[907504e1-6cd8-4208-9846-1690abade89c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] <== disconnect_volume: return (388ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.network.neutron [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updating instance_info_cache with network_info: [{"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Releasing lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] Acquired lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.network.neutron [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Refreshing network info cache for port 29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-444984251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-444984251',id=8,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrYUmyFto3lIJuJXMBF4CtTfKVUh4V940geNTK4f4QpKuvkvp83JV/2A/URZIxQB6Rti00M04f5rrnUAVtSObiD6MPSlbY3ycoBt9DEYh9gUdRaEpFW19N4OEj4Ecmh4Q==',key_name='tempest-keypair-1208398939',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='efae74f239e14c29b3af28c7fceee94d',ramdisk_id='',reservation_id='r-qypqgwqo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2056271432',owner_user_name='tempest-TaggedAttachmentsTest-2056271432-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b083d961ab7546a7bb743d034c5e0815',uuid=e3e82a4d-89b7-4bd5-8b22-f17a019e6b99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converting VIF {"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c0:5f,bridge_name='br-int',has_traffic_filtering=True,id=29934039-40ef-4f75-a712-55b7ab72c0b0,network=Network(ddba4fb2-7f51-4d51-82b8-4eb434448f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29934039-40') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_vif [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c0:5f,bridge_name='br-int',has_traffic_filtering=True,id=29934039-40ef-4f75-a712-55b7ab72c0b0,network=Network(ddba4fb2-7f51-4d51-82b8-4eb434448f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29934039-40') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29934039-40, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29934039-40, col_values=(('external_ids', {'iface-id': '29934039-40ef-4f75-a712-55b7ab72c0b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:c0:5f', 'vm-uuid': 'e3e82a4d-89b7-4bd5-8b22-f17a019e6b99'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:40 user nova-compute[71308]: INFO os_vif [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c0:5f,bridge_name='br-int',has_traffic_filtering=True,id=29934039-40ef-4f75-a712-55b7ab72c0b0,network=Network(ddba4fb2-7f51-4d51-82b8-4eb434448f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29934039-40')
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-444984251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-444984251',id=8,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrYUmyFto3lIJuJXMBF4CtTfKVUh4V940geNTK4f4QpKuvkvp83JV/2A/URZIxQB6Rti00M04f5rrnUAVtSObiD6MPSlbY3ycoBt9DEYh9gUdRaEpFW19N4OEj4Ecmh4Q==',key_name='tempest-keypair-1208398939',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='efae74f239e14c29b3af28c7fceee94d',ramdisk_id='',reservation_id='r-qypqgwqo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2056271432',owner_user_name='tempest-TaggedAttachmentsTest-2056271432-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b083d961ab7546a7bb743d034c5e0815',uuid=e3e82a4d-89b7-4bd5-8b22-f17a019e6b99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converting VIF {"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c0:5f,bridge_name='br-int',has_traffic_filtering=True,id=29934039-40ef-4f75-a712-55b7ab72c0b0,network=Network(ddba4fb2-7f51-4d51-82b8-4eb434448f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29934039-40') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] attach device xml: <interface type="ethernet">
Apr 14 18:48:40 user nova-compute[71308]:   <mac address="fa:16:3e:2e:c0:5f"/>
Apr 14 18:48:40 user nova-compute[71308]:   <model type="virtio"/>
Apr 14 18:48:40 user nova-compute[71308]:   <mtu size="1442"/>
Apr 14 18:48:40 user nova-compute[71308]:   <target dev="tap29934039-40"/>
Apr 14 18:48:40 user nova-compute[71308]: </interface>
Apr 14 18:48:40 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:40 user nova-compute[71308]: INFO nova.compute.manager [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Attaching volume ba2fc051-881a-4012-af7c-22007cc56d3b to /dev/vdb
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.network.neutron [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Updated VIF entry in instance network info cache for port fd4a0af3-b371-4b85-8a45-3b68d9884358. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.network.neutron [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Updating instance_info_cache with network_info: [{"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-816418e7-5f30-495a-a20a-dd72a687daf2 req-e38154ec-014b-4d29-8863-900285d3f41d service nova] Releasing lock "refresh_cache-e03adca9-8b0c-416c-943e-7dce251547c6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.utils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0330391-135c-40e6-a4f9-7fa58025cb45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafc5987-460e-46bc-bf19-2c6943d060d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e093569-6421-4f40-a3f9-a3b1718ddfa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0616f555-35df-4266-968f-0d8781a2af27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:40 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:48:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a307baf-4f1e-4a12-9874-a323939ec007]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG os_brick.utils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:40 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Updating existing volume attachment record: f47802b0-6708-4c06-94d3-e9d6f32a5425 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498121.0719101, 499df49b-4a00-447b-bd2f-b027fb44f3b8 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:48:41 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Successfully detached device sdc from instance 499df49b-4a00-447b-bd2f-b027fb44f3b8 from the live domain config.
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NycVpzjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:41 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd3632-8bde-4666-b605-dde9d282c8ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:48:41 user nova-compute[71308]: No targets found.
Apr 14 18:48:41 user nova-compute[71308]: iSNS:
Apr 14 18:48:41 user nova-compute[71308]: No targets found.
Apr 14 18:48:41 user nova-compute[71308]: STATIC:
Apr 14 18:48:41 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca
Apr 14 18:48:41 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:41 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:41 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786
Apr 14 18:48:41 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:41 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:41 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea
Apr 14 18:48:41 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:41 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:41 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019
Apr 14 18:48:41 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:41 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:41 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:48:41 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:41 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:41 user nova-compute[71308]: FIRMWARE:
Apr 14 18:48:41 user nova-compute[71308]: No targets found.
Apr 14 18:48:41 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:48:41 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:48:41 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b3d480-e43e-4937-8077-85f9a2d6a82b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] No BDM found with device name hda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] No VIF found with MAC fa:16:3e:07:da:92, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[584e52c5-37ad-4e3d-9f92-dae7dbef9deb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:41 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:41 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:41 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:41 user nova-compute[71308]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea (non-flash)
Apr 14 18:48:41 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:41 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:41 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:41 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:41 user nova-compute[71308]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea (non-flash)
Apr 14 18:48:41 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22540fa9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea'): ({'sdg'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Removing single pathed devices sdg {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e49902-4548-4ebc-9e22-7324102a6d6f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:48:41 user nova-compute[71308]:   <nova:package version="0.0.0"/>
Apr 14 18:48:41 user nova-compute[71308]:   <nova:name>tempest-device-tagging-server-444984251</nova:name>
Apr 14 18:48:41 user nova-compute[71308]:   <nova:creationTime>2023-04-14 18:48:41</nova:creationTime>
Apr 14 18:48:41 user nova-compute[71308]:   <nova:flavor name="m1.nano">
Apr 14 18:48:41 user nova-compute[71308]:     <nova:memory>128</nova:memory>
Apr 14 18:48:41 user nova-compute[71308]:     <nova:disk>1</nova:disk>
Apr 14 18:48:41 user nova-compute[71308]:     <nova:swap>0</nova:swap>
Apr 14 18:48:41 user nova-compute[71308]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:48:41 user nova-compute[71308]:     <nova:vcpus>1</nova:vcpus>
Apr 14 18:48:41 user nova-compute[71308]:   </nova:flavor>
Apr 14 18:48:41 user nova-compute[71308]:   <nova:owner>
Apr 14 18:48:41 user nova-compute[71308]:     <nova:user uuid="b083d961ab7546a7bb743d034c5e0815">tempest-TaggedAttachmentsTest-2056271432-project-member</nova:user>
Apr 14 18:48:41 user nova-compute[71308]:     <nova:project uuid="efae74f239e14c29b3af28c7fceee94d">tempest-TaggedAttachmentsTest-2056271432</nova:project>
Apr 14 18:48:41 user nova-compute[71308]:   </nova:owner>
Apr 14 18:48:41 user nova-compute[71308]:   <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:48:41 user nova-compute[71308]:   <nova:ports>
Apr 14 18:48:41 user nova-compute[71308]:     <nova:port uuid="a23ae571-1be9-4877-b629-567eb9c62b9d">
Apr 14 18:48:41 user nova-compute[71308]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 18:48:41 user nova-compute[71308]:     </nova:port>
Apr 14 18:48:41 user nova-compute[71308]:     <nova:port uuid="29934039-40ef-4f75-a712-55b7ab72c0b0">
Apr 14 18:48:41 user nova-compute[71308]:       <nova:ip type="fixed" address="10.10.10.214" ipVersion="4"/>
Apr 14 18:48:41 user nova-compute[71308]:     </nova:port>
Apr 14 18:48:41 user nova-compute[71308]:   </nova:ports>
Apr 14 18:48:41 user nova-compute[71308]: </nova:instance>
Apr 14 18:48:41 user nova-compute[71308]:  {{(pid=71308) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4046cdff-8131-4b4e-a840-ada7a6a25523]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Flushing IO for device /dev/sdg {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bf4faf40-cb0c-4a65-9ba3-d1665a3afead tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "interface-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.571s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9a11ee-4680-4bfb-a24e-c32a043e5f97]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4541b14-efa0-48dc-b1d6-14ddfb9b704a]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'flavor' on Instance uuid 817f112c-d806-4800-9e4a-a3892c54bee1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc99666-9b6c-4413-be74-b3bc27eae313]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc319a48-0033-4232-9a8a-3b1629f1d71d tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.225s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ffd334-e7d3-4ce7-9017-5f35e1f4ab36]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea, portal: 172.16.0.220,3260]
Apr 14 18:48:41 user nova-compute[71308]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:41 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9925aa7-e3bf-4bff-ac58-d534eae3beea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9334b6-33fa-4fe0-a43b-73b11958e945]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] <== disconnect_volume: return (391ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.network.neutron [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updated VIF entry in instance network info cache for port 29934039-40ef-4f75-a712-55b7ab72c0b0. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.network.neutron [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updating instance_info_cache with network_info: [{"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9339b02f-f44d-472f-acc9-30867c4545ae req-31daae50-e120-48b4-bb56-0d4dd6f0948e service nova] Releasing lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-plugged-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-plugged-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:41 user nova-compute[71308]: WARNING nova.compute.manager [req-26318216-e550-4557-af4b-12fa35147538 req-17236375-f91c-4a3f-86cd-7fc04d0ffa08 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-plugged-29934039-40ef-4f75-a712-55b7ab72c0b0 for instance with vm_state active and task_state None.
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG nova.objects.instance [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'flavor' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:41 user nova-compute[71308]: INFO nova.compute.manager [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Attaching volume 786535d2-c800-442a-bc6d-c788f7b28bdf to /dev/vdb
Apr 14 18:48:42 user nova-compute[71308]: DEBUG os_brick.utils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e7e7b4-41aa-4044-971c-90577ba583e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a37e99-0c89-43b2-825e-f85efea01e63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d08b25-e88b-4737-b7c2-301d0d74dd78]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d775595-b010-4e12-b17c-6a788e1c8a2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:42 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16d8859-0f12-4195-932a-945623d3d1a6]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG os_brick.utils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updating existing volume attachment record: 2656dd2f-0249-475f-b249-037c39acc7de {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG nova.objects.instance [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lazy-loading 'flavor' on Instance uuid 499df49b-4a00-447b-bd2f-b027fb44f3b8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-86d6a947-62fa-4436-bbd1-ab34593eaef0 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.234s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:42 user nova-compute[71308]: INFO nova.compute.manager [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Terminating instance
Apr 14 18:48:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:43 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Instance destroyed successfully.
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.objects.instance [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lazy-loading 'resources' on Instance uuid 499df49b-4a00-447b-bd2f-b027fb44f3b8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-608469179',display_name='tempest-AttachSCSIVolumeTestJSON-server-608469179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-608469179',id=7,image_ref='aac26e93-820f-4f38-ad93-d0c6602bcb5f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9u1JlSuD1cJAMQzALjI/JyGRN1rOQcOW5ycbxEjDT60K921QCb9ZxtUq1EWTeVNJbS0jsJLL5PQkFgQAgckmcDooUDCEzR2biHJb/yfJQBTKMSdOIvYWSmMVbMc7s+9Q==',key_name='tempest-keypair-1864669462',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ef3347089a742cd8533322deb96b4d0',ramdisk_id='',reservation_id='r-ki1uz5ox',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='aac26e93-820f-4f38-ad93-d0c6602bcb5f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1744957481',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1744957481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6224225e832d40e986e1f145295621df',uuid=499df49b-4a00-447b-bd2f-b027fb44f3b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Converting VIF {"id": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "address": "fa:16:3e:fb:94:e2", "network": {"id": "a7f1f9e5-21ae-4bde-a369-ba247ce72d1a", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-201476832-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ef3347089a742cd8533322deb96b4d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51aafe60-87", "ovs_interfaceid": "51aafe60-87de-4ca9-8168-cbac2aeb557e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=51aafe60-87de-4ca9-8168-cbac2aeb557e,network=Network(a7f1f9e5-21ae-4bde-a369-ba247ce72d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51aafe60-87') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG os_vif [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=51aafe60-87de-4ca9-8168-cbac2aeb557e,network=Network(a7f1f9e5-21ae-4bde-a369-ba247ce72d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51aafe60-87') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51aafe60-87, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:43 user nova-compute[71308]: INFO os_vif [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:94:e2,bridge_name='br-int',has_traffic_filtering=True,id=51aafe60-87de-4ca9-8168-cbac2aeb557e,network=Network(a7f1f9e5-21ae-4bde-a369-ba247ce72d1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51aafe60-87')
Apr 14 18:48:43 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Deleting instance files /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8_del
Apr 14 18:48:43 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Deletion of /opt/stack/data/nova/instances/499df49b-4a00-447b-bd2f-b027fb44f3b8_del complete
Apr 14 18:48:43 user nova-compute[71308]: INFO nova.compute.manager [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-plugged-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-plugged-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:43 user nova-compute[71308]: WARNING nova.compute.manager [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-plugged-29934039-40ef-4f75-a712-55b7ab72c0b0 for instance with vm_state active and task_state None.
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received event network-vif-unplugged-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] No waiting events found dispatching network-vif-unplugged-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received event network-vif-unplugged-51aafe60-87de-4ca9-8168-cbac2aeb557e for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received event network-vif-plugged-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Acquiring lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] No waiting events found dispatching network-vif-plugged-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:43 user nova-compute[71308]: WARNING nova.compute.manager [req-d9ec8ae5-4a11-47fe-97c7-dfe34aaea381 req-338de4a8-76af-4e7d-86cf-2843e2ae38c0 service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received unexpected event network-vif-plugged-51aafe60-87de-4ca9-8168-cbac2aeb557e for instance with vm_state active and task_state deleting.
Apr 14 18:48:44 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:44 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Took 1.12 seconds to deallocate network for instance.
Apr 14 18:48:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:45 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Deleted allocations for instance 499df49b-4a00-447b-bd2f-b027fb44f3b8
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-835c13cc-ec80-444f-ab85-5c1adf638c28 tempest-AttachSCSIVolumeTestJSON-1744957481 tempest-AttachSCSIVolumeTestJSON-1744957481-project-member] Lock "499df49b-4a00-447b-bd2f-b027fb44f3b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-5ba675f4-d779-431b-92c8-ed7d40c00fd1 req-66b8dd44-fc7e-4aa0-9ae3-a449a18f7c5f service nova] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Received event network-vif-deleted-51aafe60-87de-4ca9-8168-cbac2aeb557e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJFcgyqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:45 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:45 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:45 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00c18df-8e67-4f45-a339-935ecd073768]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:48:45 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f025fa50-24e0-44c8-b696-3e4e14a9c154]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b] added
Apr 14 18:48:45 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d652eb-faa6-4c6a-bbb7-0cbe5d634517]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a711671a-98bc-4a6e-8f83-2cdb8464c873]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJFcgyqi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJFcgyqi" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ee2f5-ba96-491c-b384-08e509bd78a2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJFcgyqi'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04a23ad-6d73-4ea2-a299-500adfd4dc7e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf71dc2-f56d-467b-bb80-69563eb98ada]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:45 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:45 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:45 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:45 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:45 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:45 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:45 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:45 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fcb765-3e5f-40e1-b3b2-6226ec4557ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260]
Apr 14 18:48:46 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c912c-688e-411e-b390-c7e4b3f023b5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f92f72e-66dd-47ea-8b80-7d2ea842728e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:46 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:46 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:46 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:46 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:46 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:46 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:46 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:46 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d244c269-9b26-44a7-a718-d89ff75e9815]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVKWwilB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:46 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJFcgyqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23366616166613263', 'path': '/dev/sdf'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366616166613263', 'path': '/dev/sdf'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.399s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:47 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:47 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG nova.objects.instance [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lazy-loading 'flavor' on Instance uuid e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70382ac-f088-4acc-8cab-a6333b878bb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:48:47 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:48:47 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:47 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:48:47 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:48:47 user nova-compute[71308]:   <serial>ba2fc051-881a-4012-af7c-22007cc56d3b</serial>
Apr 14 18:48:47 user nova-compute[71308]: </disk>
Apr 14 18:48:47 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1b0d29-72f9-4ccf-910a-6b611248d8d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf] added
Apr 14 18:48:47 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a4efeb-3872-4a48-9c6b-6affaa14d970]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e1e7c1-1c6c-4f07-9fa5-aee0a4d1c7df]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVKWwilB {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVKWwilB" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b332f71-8ff1-4bd4-aab6-8ae26a1b4c19]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YVKWwilB'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8e3669-5b3e-402c-abb0-8bc3c1edc2cb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcda064-6e34-463a-be7b-30963a7e6d4e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:47 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:47 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb43ee30-ffd3-43ea-aa94-ef477e120157]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf, portal: 172.16.0.220,3260]
Apr 14 18:48:47 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:47 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c71c3f2-e240-4df4-b643-71f75e51ffb7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7757ed6c-5609-4bd1-9656-adfb822417df]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:47 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:47 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:47 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0232e7d0-aaf2-4faf-a391-ae305635f7a7]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] No VIF found with MAC fa:16:3e:27:37:70, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-54e38cf9-554b-4d85-a843-e0a16412b668 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.078s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVKWwilB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] <== connect_volume: return (1744ms) {'type': 'block', 'scsi_wwn': '23863663565373036', 'path': '/dev/sdg'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863663565373036', 'path': '/dev/sdg'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG nova.objects.instance [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'flavor' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:48:48 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:48 user nova-compute[71308]:   <source dev="/dev/sdg"/>
Apr 14 18:48:48 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:48:48 user nova-compute[71308]:   <serial>786535d2-c800-442a-bc6d-c788f7b28bdf</serial>
Apr 14 18:48:48 user nova-compute[71308]: </disk>
Apr 14 18:48:48 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.utils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[38970099-bf42-4ea9-8bdb-2a2a0073f08d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6f1202-25e4-4e2d-8179-9b67b6bdca01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a01138f-fe96-4b99-992d-f9fb680cb9c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[48af47c8-e084-4ce5-bab6-ec0d31c5557f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:48:48 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:48:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fc9d70-0b07-4cdf-aa38-df3be91ce161]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG os_brick.utils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] No BDM found with device name hda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:48:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] No VIF found with MAC fa:16:3e:07:da:92, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:48:49 user nova-compute[71308]: INFO nova.compute.manager [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Swapping volume ba2fc051-881a-4012-af7c-22007cc56d3b for 7646c367-81d4-43cd-bb7a-97ecdd4f9576
Apr 14 18:48:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dc4a03bc-57cc-45fa-8f30-bd12d28a7689 tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.144s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:50 user nova-compute[71308]: INFO nova.compute.manager [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Detaching volume 786535d2-c800-442a-bc6d-c788f7b28bdf
Apr 14 18:48:50 user nova-compute[71308]: INFO nova.virt.block_device [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Attempting to driver detach volume 786535d2-c800-442a-bc6d-c788f7b28bdf from mountpoint /dev/vdb
Apr 14 18:48:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Attempting to detach device vdb from instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:48:50 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:50 user nova-compute[71308]:   <source dev="/dev/sdg"/>
Apr 14 18:48:50 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:48:50 user nova-compute[71308]:   <serial>786535d2-c800-442a-bc6d-c788f7b28bdf</serial>
Apr 14 18:48:50 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 18:48:50 user nova-compute[71308]: </disk>
Apr 14 18:48:50 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:48:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Successfully detached device vdb from instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 from the persistent domain config.
Apr 14 18:48:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:48:50 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:48:50 user nova-compute[71308]:   <source dev="/dev/sdg"/>
Apr 14 18:48:50 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:48:50 user nova-compute[71308]:   <serial>786535d2-c800-442a-bc6d-c788f7b28bdf</serial>
Apr 14 18:48:50 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 18:48:50 user nova-compute[71308]: </disk>
Apr 14 18:48:50 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498130.5365734, e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:48:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Successfully detached device vdb from instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 from the live domain config.
Apr 14 18:48:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVKWwilB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:50 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[249d973a-55ab-4780-9898-0224c30dea9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:48:50 user nova-compute[71308]: No targets found.
Apr 14 18:48:50 user nova-compute[71308]: iSNS:
Apr 14 18:48:50 user nova-compute[71308]: No targets found.
Apr 14 18:48:50 user nova-compute[71308]: STATIC:
Apr 14 18:48:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf
Apr 14 18:48:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b
Apr 14 18:48:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca
Apr 14 18:48:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786
Apr 14 18:48:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019
Apr 14 18:48:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:48:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:50 user nova-compute[71308]: FIRMWARE:
Apr 14 18:48:50 user nova-compute[71308]: No targets found.
Apr 14 18:48:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:48:50 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:48:50 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e87b2c-128c-4eb2-a680-52fbd429be4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b40f12-cf63-4b73-a3e4-f7c4837f7cf2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:50 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f226c2f8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf'): ({'sdg'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Removing single pathed devices sdg {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c49c2-7d1a-42ba-bcb9-8faeb340f21d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb5f54-3c08-4bad-b3f3-c83bbc042156]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Flushing IO for device /dev/sdg {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3b25d4-79e0-4efd-b72c-164e4d17bd88]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e06fe6-bb68-4475-a77d-6e382c62b359]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dfe7d4-43ae-43cf-bae7-4172a97ffe2a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8902c2ff-e030-4c0b-8da2-5423bf09e391]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf, portal: 172.16.0.220,3260]
Apr 14 18:48:50 user nova-compute[71308]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:786535d2-c800-442a-bc6d-c788f7b28bdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[be26bc5e-36f2-4cf1-b3cd-dc8e251615e8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] <== disconnect_volume: return (306ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:48:51 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'flavor' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2b7741b4-173b-4c2f-b442-07c9e7034e9e tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.703s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "interface-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-29934039-40ef-4f75-a712-55b7ab72c0b0" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "interface-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-29934039-40ef-4f75-a712-55b7ab72c0b0" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.objects.instance [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'flavor' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-444984251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-444984251',id=8,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrYUmyFto3lIJuJXMBF4CtTfKVUh4V940geNTK4f4QpKuvkvp83JV/2A/URZIxQB6Rti00M04f5rrnUAVtSObiD6MPSlbY3ycoBt9DEYh9gUdRaEpFW19N4OEj4Ecmh4Q==',key_name='tempest-keypair-1208398939',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efae74f239e14c29b3af28c7fceee94d',ramdisk_id='',reservation_id='r-qypqgwqo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2056271432',owner_user_name='tempest-TaggedAttachmentsTest-2056271432-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b083d961ab7546a7bb743d034c5e0815',uuid=e3e82a4d-89b7-4bd5-8b22-f17a019e6b99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converting VIF {"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c0:5f,bridge_name='br-int',has_traffic_filtering=True,id=29934039-40ef-4f75-a712-55b7ab72c0b0,network=Network(ddba4fb2-7f51-4d51-82b8-4eb434448f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29934039-40') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c0:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap29934039-40"/></interface> {{(pid=71308) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c0:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap29934039-40"/></interface> {{(pid=71308) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Attempting to detach device tap29934039-40 from instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] detach device xml: <interface type="ethernet">
Apr 14 18:48:52 user nova-compute[71308]:   <mac address="fa:16:3e:2e:c0:5f"/>
Apr 14 18:48:52 user nova-compute[71308]:   <model type="virtio"/>
Apr 14 18:48:52 user nova-compute[71308]:   <mtu size="1442"/>
Apr 14 18:48:52 user nova-compute[71308]:   <target dev="tap29934039-40"/>
Apr 14 18:48:52 user nova-compute[71308]: </interface>
Apr 14 18:48:52 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c0:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap29934039-40"/></interface> {{(pid=71308) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2e:c0:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap29934039-40"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 14 18:48:52 user nova-compute[71308]:   <name>instance-00000008</name>
Apr 14 18:48:52 user nova-compute[71308]:   <uuid>e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</uuid>
Apr 14 18:48:52 user nova-compute[71308]:   <metadata>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:48:52 user nova-compute[71308]:   <nova:package version="0.0.0"/>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:name>tempest-device-tagging-server-444984251</nova:name>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:creationTime>2023-04-14 18:48:41</nova:creationTime>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:flavor name="m1.nano">
Apr 14 18:48:52 user nova-compute[71308]:     <nova:memory>128</nova:memory>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:disk>1</nova:disk>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:swap>0</nova:swap>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:vcpus>1</nova:vcpus>
Apr 14 18:48:52 user nova-compute[71308]:   </nova:flavor>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:owner>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:user uuid="b083d961ab7546a7bb743d034c5e0815">tempest-TaggedAttachmentsTest-2056271432-project-member</nova:user>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:project uuid="efae74f239e14c29b3af28c7fceee94d">tempest-TaggedAttachmentsTest-2056271432</nova:project>
Apr 14 18:48:52 user nova-compute[71308]:   </nova:owner>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:ports>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:port uuid="a23ae571-1be9-4877-b629-567eb9c62b9d">
Apr 14 18:48:52 user nova-compute[71308]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 18:48:52 user nova-compute[71308]:     </nova:port>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:port uuid="29934039-40ef-4f75-a712-55b7ab72c0b0">
Apr 14 18:48:52 user nova-compute[71308]:       <nova:ip type="fixed" address="10.10.10.214" ipVersion="4"/>
Apr 14 18:48:52 user nova-compute[71308]:     </nova:port>
Apr 14 18:48:52 user nova-compute[71308]:   </nova:ports>
Apr 14 18:48:52 user nova-compute[71308]: </nova:instance>
Apr 14 18:48:52 user nova-compute[71308]:   </metadata>
Apr 14 18:48:52 user nova-compute[71308]:   <memory unit='KiB'>131072</memory>
Apr 14 18:48:52 user nova-compute[71308]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 18:48:52 user nova-compute[71308]:   <vcpu placement='static'>1</vcpu>
Apr 14 18:48:52 user nova-compute[71308]:   <resource>
Apr 14 18:48:52 user nova-compute[71308]:     <partition>/machine</partition>
Apr 14 18:48:52 user nova-compute[71308]:   </resource>
Apr 14 18:48:52 user nova-compute[71308]:   <sysinfo type='smbios'>
Apr 14 18:48:52 user nova-compute[71308]:     <system>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='version'>0.0.0</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='serial'>e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='uuid'>e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='family'>Virtual Machine</entry>
Apr 14 18:48:52 user nova-compute[71308]:     </system>
Apr 14 18:48:52 user nova-compute[71308]:   </sysinfo>
Apr 14 18:48:52 user nova-compute[71308]:   <os>
Apr 14 18:48:52 user nova-compute[71308]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 18:48:52 user nova-compute[71308]:     <boot dev='hd'/>
Apr 14 18:48:52 user nova-compute[71308]:     <smbios mode='sysinfo'/>
Apr 14 18:48:52 user nova-compute[71308]:   </os>
Apr 14 18:48:52 user nova-compute[71308]:   <features>
Apr 14 18:48:52 user nova-compute[71308]:     <acpi/>
Apr 14 18:48:52 user nova-compute[71308]:     <apic/>
Apr 14 18:48:52 user nova-compute[71308]:     <vmcoreinfo state='on'/>
Apr 14 18:48:52 user nova-compute[71308]:   </features>
Apr 14 18:48:52 user nova-compute[71308]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 18:48:52 user nova-compute[71308]:     <model fallback='forbid'>Nehalem</model>
Apr 14 18:48:52 user nova-compute[71308]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 18:48:52 user nova-compute[71308]:     <feature policy='require' name='vme'/>
Apr 14 18:48:52 user nova-compute[71308]:     <feature policy='require' name='x2apic'/>
Apr 14 18:48:52 user nova-compute[71308]:     <feature policy='require' name='hypervisor'/>
Apr 14 18:48:52 user nova-compute[71308]:   </cpu>
Apr 14 18:48:52 user nova-compute[71308]:   <clock offset='utc'>
Apr 14 18:48:52 user nova-compute[71308]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 18:48:52 user nova-compute[71308]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 18:48:52 user nova-compute[71308]:     <timer name='hpet' present='no'/>
Apr 14 18:48:52 user nova-compute[71308]:   </clock>
Apr 14 18:48:52 user nova-compute[71308]:   <on_poweroff>destroy</on_poweroff>
Apr 14 18:48:52 user nova-compute[71308]:   <on_reboot>restart</on_reboot>
Apr 14 18:48:52 user nova-compute[71308]:   <on_crash>destroy</on_crash>
Apr 14 18:48:52 user nova-compute[71308]:   <devices>
Apr 14 18:48:52 user nova-compute[71308]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 18:48:52 user nova-compute[71308]:     <disk type='file' device='disk'>
Apr 14 18:48:52 user nova-compute[71308]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 18:48:52 user nova-compute[71308]:       <source file='/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk' index='2'/>
Apr 14 18:48:52 user nova-compute[71308]:       <backingStore type='file' index='3'>
Apr 14 18:48:52 user nova-compute[71308]:         <format type='raw'/>
Apr 14 18:48:52 user nova-compute[71308]:         <source file='/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88'/>
Apr 14 18:48:52 user nova-compute[71308]:         <backingStore/>
Apr 14 18:48:52 user nova-compute[71308]:       </backingStore>
Apr 14 18:48:52 user nova-compute[71308]:       <target dev='vda' bus='virtio'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='virtio-disk0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </disk>
Apr 14 18:48:52 user nova-compute[71308]:     <disk type='file' device='cdrom'>
Apr 14 18:48:52 user nova-compute[71308]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 18:48:52 user nova-compute[71308]:       <source file='/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk.config' index='1'/>
Apr 14 18:48:52 user nova-compute[71308]:       <backingStore/>
Apr 14 18:48:52 user nova-compute[71308]:       <target dev='hda' bus='ide'/>
Apr 14 18:48:52 user nova-compute[71308]:       <readonly/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='ide0-0-0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </disk>
Apr 14 18:48:52 user nova-compute[71308]:     <controller type='usb' index='0' model='none'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='usb'/>
Apr 14 18:48:52 user nova-compute[71308]:     </controller>
Apr 14 18:48:52 user nova-compute[71308]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='pci.0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </controller>
Apr 14 18:48:52 user nova-compute[71308]:     <controller type='ide' index='0'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='ide'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 18:48:52 user nova-compute[71308]:     </controller>
Apr 14 18:48:52 user nova-compute[71308]:     <interface type='ethernet'>
Apr 14 18:48:52 user nova-compute[71308]:       <mac address='fa:16:3e:07:da:92'/>
Apr 14 18:48:52 user nova-compute[71308]:       <target dev='tapa23ae571-1b'/>
Apr 14 18:48:52 user nova-compute[71308]:       <model type='virtio'/>
Apr 14 18:48:52 user nova-compute[71308]:       <mtu size='1442'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='net0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </interface>
Apr 14 18:48:52 user nova-compute[71308]:     <interface type='ethernet'>
Apr 14 18:48:52 user nova-compute[71308]:       <mac address='fa:16:3e:2e:c0:5f'/>
Apr 14 18:48:52 user nova-compute[71308]:       <target dev='tap29934039-40'/>
Apr 14 18:48:52 user nova-compute[71308]:       <model type='virtio'/>
Apr 14 18:48:52 user nova-compute[71308]:       <mtu size='1442'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='net1'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </interface>
Apr 14 18:48:52 user nova-compute[71308]:     <serial type='pty'>
Apr 14 18:48:52 user nova-compute[71308]:       <source path='/dev/pts/7'/>
Apr 14 18:48:52 user nova-compute[71308]:       <log file='/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/console.log' append='off'/>
Apr 14 18:48:52 user nova-compute[71308]:       <target type='isa-serial' port='0'>
Apr 14 18:48:52 user nova-compute[71308]:         <model name='isa-serial'/>
Apr 14 18:48:52 user nova-compute[71308]:       </target>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='serial0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </serial>
Apr 14 18:48:52 user nova-compute[71308]:     <console type='pty' tty='/dev/pts/7'>
Apr 14 18:48:52 user nova-compute[71308]:       <source path='/dev/pts/7'/>
Apr 14 18:48:52 user nova-compute[71308]:       <log file='/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/console.log' append='off'/>
Apr 14 18:48:52 user nova-compute[71308]:       <target type='serial' port='0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='serial0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </console>
Apr 14 18:48:52 user nova-compute[71308]:     <input type='mouse' bus='ps2'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='input0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </input>
Apr 14 18:48:52 user nova-compute[71308]:     <input type='keyboard' bus='ps2'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='input1'/>
Apr 14 18:48:52 user nova-compute[71308]:     </input>
Apr 14 18:48:52 user nova-compute[71308]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 14 18:48:52 user nova-compute[71308]:       <listen type='address' address='0.0.0.0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </graphics>
Apr 14 18:48:52 user nova-compute[71308]:     <audio id='1' type='none'/>
Apr 14 18:48:52 user nova-compute[71308]:     <video>
Apr 14 18:48:52 user nova-compute[71308]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='video0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </video>
Apr 14 18:48:52 user nova-compute[71308]:     <memballoon model='virtio'>
Apr 14 18:48:52 user nova-compute[71308]:       <stats period='10'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='balloon0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </memballoon>
Apr 14 18:48:52 user nova-compute[71308]:     <rng model='virtio'>
Apr 14 18:48:52 user nova-compute[71308]:       <backend model='random'>/dev/urandom</backend>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='rng0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </rng>
Apr 14 18:48:52 user nova-compute[71308]:   </devices>
Apr 14 18:48:52 user nova-compute[71308]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 18:48:52 user nova-compute[71308]:     <label>libvirt-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</label>
Apr 14 18:48:52 user nova-compute[71308]:     <imagelabel>libvirt-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</imagelabel>
Apr 14 18:48:52 user nova-compute[71308]:   </seclabel>
Apr 14 18:48:52 user nova-compute[71308]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 18:48:52 user nova-compute[71308]:     <label>+64055:+108</label>
Apr 14 18:48:52 user nova-compute[71308]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 18:48:52 user nova-compute[71308]:   </seclabel>
Apr 14 18:48:52 user nova-compute[71308]: </domain>
Apr 14 18:48:52 user nova-compute[71308]:  {{(pid=71308) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 18:48:52 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Successfully detached device tap29934039-40 from instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 from the persistent domain config.
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] (1/8): Attempting to detach device tap29934039-40 with device alias net1 from instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] detach device xml: <interface type="ethernet">
Apr 14 18:48:52 user nova-compute[71308]:   <mac address="fa:16:3e:2e:c0:5f"/>
Apr 14 18:48:52 user nova-compute[71308]:   <model type="virtio"/>
Apr 14 18:48:52 user nova-compute[71308]:   <mtu size="1442"/>
Apr 14 18:48:52 user nova-compute[71308]:   <target dev="tap29934039-40"/>
Apr 14 18:48:52 user nova-compute[71308]: </interface>
Apr 14 18:48:52 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498132.5444262, e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Start waiting for the detach event from libvirt for device tap29934039-40 with device alias net1 for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2e:c0:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap29934039-40"/></interface> {{(pid=71308) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2e:c0:5f"/><model type="virtio"/><mtu size="1442"/><target dev="tap29934039-40"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 14 18:48:52 user nova-compute[71308]:   <name>instance-00000008</name>
Apr 14 18:48:52 user nova-compute[71308]:   <uuid>e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</uuid>
Apr 14 18:48:52 user nova-compute[71308]:   <metadata>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:48:52 user nova-compute[71308]:   <nova:package version="0.0.0"/>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:name>tempest-device-tagging-server-444984251</nova:name>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:creationTime>2023-04-14 18:48:41</nova:creationTime>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:flavor name="m1.nano">
Apr 14 18:48:52 user nova-compute[71308]:     <nova:memory>128</nova:memory>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:disk>1</nova:disk>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:swap>0</nova:swap>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:vcpus>1</nova:vcpus>
Apr 14 18:48:52 user nova-compute[71308]:   </nova:flavor>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:owner>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:user uuid="b083d961ab7546a7bb743d034c5e0815">tempest-TaggedAttachmentsTest-2056271432-project-member</nova:user>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:project uuid="efae74f239e14c29b3af28c7fceee94d">tempest-TaggedAttachmentsTest-2056271432</nova:project>
Apr 14 18:48:52 user nova-compute[71308]:   </nova:owner>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:ports>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:port uuid="a23ae571-1be9-4877-b629-567eb9c62b9d">
Apr 14 18:48:52 user nova-compute[71308]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 18:48:52 user nova-compute[71308]:     </nova:port>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:port uuid="29934039-40ef-4f75-a712-55b7ab72c0b0">
Apr 14 18:48:52 user nova-compute[71308]:       <nova:ip type="fixed" address="10.10.10.214" ipVersion="4"/>
Apr 14 18:48:52 user nova-compute[71308]:     </nova:port>
Apr 14 18:48:52 user nova-compute[71308]:   </nova:ports>
Apr 14 18:48:52 user nova-compute[71308]: </nova:instance>
Apr 14 18:48:52 user nova-compute[71308]:   </metadata>
Apr 14 18:48:52 user nova-compute[71308]:   <memory unit='KiB'>131072</memory>
Apr 14 18:48:52 user nova-compute[71308]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 18:48:52 user nova-compute[71308]:   <vcpu placement='static'>1</vcpu>
Apr 14 18:48:52 user nova-compute[71308]:   <resource>
Apr 14 18:48:52 user nova-compute[71308]:     <partition>/machine</partition>
Apr 14 18:48:52 user nova-compute[71308]:   </resource>
Apr 14 18:48:52 user nova-compute[71308]:   <sysinfo type='smbios'>
Apr 14 18:48:52 user nova-compute[71308]:     <system>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='version'>0.0.0</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='serial'>e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='uuid'>e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</entry>
Apr 14 18:48:52 user nova-compute[71308]:       <entry name='family'>Virtual Machine</entry>
Apr 14 18:48:52 user nova-compute[71308]:     </system>
Apr 14 18:48:52 user nova-compute[71308]:   </sysinfo>
Apr 14 18:48:52 user nova-compute[71308]:   <os>
Apr 14 18:48:52 user nova-compute[71308]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 18:48:52 user nova-compute[71308]:     <boot dev='hd'/>
Apr 14 18:48:52 user nova-compute[71308]:     <smbios mode='sysinfo'/>
Apr 14 18:48:52 user nova-compute[71308]:   </os>
Apr 14 18:48:52 user nova-compute[71308]:   <features>
Apr 14 18:48:52 user nova-compute[71308]:     <acpi/>
Apr 14 18:48:52 user nova-compute[71308]:     <apic/>
Apr 14 18:48:52 user nova-compute[71308]:     <vmcoreinfo state='on'/>
Apr 14 18:48:52 user nova-compute[71308]:   </features>
Apr 14 18:48:52 user nova-compute[71308]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 18:48:52 user nova-compute[71308]:     <model fallback='forbid'>Nehalem</model>
Apr 14 18:48:52 user nova-compute[71308]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 18:48:52 user nova-compute[71308]:     <feature policy='require' name='vme'/>
Apr 14 18:48:52 user nova-compute[71308]:     <feature policy='require' name='x2apic'/>
Apr 14 18:48:52 user nova-compute[71308]:     <feature policy='require' name='hypervisor'/>
Apr 14 18:48:52 user nova-compute[71308]:   </cpu>
Apr 14 18:48:52 user nova-compute[71308]:   <clock offset='utc'>
Apr 14 18:48:52 user nova-compute[71308]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 18:48:52 user nova-compute[71308]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 18:48:52 user nova-compute[71308]:     <timer name='hpet' present='no'/>
Apr 14 18:48:52 user nova-compute[71308]:   </clock>
Apr 14 18:48:52 user nova-compute[71308]:   <on_poweroff>destroy</on_poweroff>
Apr 14 18:48:52 user nova-compute[71308]:   <on_reboot>restart</on_reboot>
Apr 14 18:48:52 user nova-compute[71308]:   <on_crash>destroy</on_crash>
Apr 14 18:48:52 user nova-compute[71308]:   <devices>
Apr 14 18:48:52 user nova-compute[71308]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 18:48:52 user nova-compute[71308]:     <disk type='file' device='disk'>
Apr 14 18:48:52 user nova-compute[71308]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 18:48:52 user nova-compute[71308]:       <source file='/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk' index='2'/>
Apr 14 18:48:52 user nova-compute[71308]:       <backingStore type='file' index='3'>
Apr 14 18:48:52 user nova-compute[71308]:         <format type='raw'/>
Apr 14 18:48:52 user nova-compute[71308]:         <source file='/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88'/>
Apr 14 18:48:52 user nova-compute[71308]:         <backingStore/>
Apr 14 18:48:52 user nova-compute[71308]:       </backingStore>
Apr 14 18:48:52 user nova-compute[71308]:       <target dev='vda' bus='virtio'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='virtio-disk0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </disk>
Apr 14 18:48:52 user nova-compute[71308]:     <disk type='file' device='cdrom'>
Apr 14 18:48:52 user nova-compute[71308]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 18:48:52 user nova-compute[71308]:       <source file='/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk.config' index='1'/>
Apr 14 18:48:52 user nova-compute[71308]:       <backingStore/>
Apr 14 18:48:52 user nova-compute[71308]:       <target dev='hda' bus='ide'/>
Apr 14 18:48:52 user nova-compute[71308]:       <readonly/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='ide0-0-0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </disk>
Apr 14 18:48:52 user nova-compute[71308]:     <controller type='usb' index='0' model='none'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='usb'/>
Apr 14 18:48:52 user nova-compute[71308]:     </controller>
Apr 14 18:48:52 user nova-compute[71308]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='pci.0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </controller>
Apr 14 18:48:52 user nova-compute[71308]:     <controller type='ide' index='0'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='ide'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 18:48:52 user nova-compute[71308]:     </controller>
Apr 14 18:48:52 user nova-compute[71308]:     <interface type='ethernet'>
Apr 14 18:48:52 user nova-compute[71308]:       <mac address='fa:16:3e:07:da:92'/>
Apr 14 18:48:52 user nova-compute[71308]:       <target dev='tapa23ae571-1b'/>
Apr 14 18:48:52 user nova-compute[71308]:       <model type='virtio'/>
Apr 14 18:48:52 user nova-compute[71308]:       <mtu size='1442'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='net0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </interface>
Apr 14 18:48:52 user nova-compute[71308]:     <serial type='pty'>
Apr 14 18:48:52 user nova-compute[71308]:       <source path='/dev/pts/7'/>
Apr 14 18:48:52 user nova-compute[71308]:       <log file='/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/console.log' append='off'/>
Apr 14 18:48:52 user nova-compute[71308]:       <target type='isa-serial' port='0'>
Apr 14 18:48:52 user nova-compute[71308]:         <model name='isa-serial'/>
Apr 14 18:48:52 user nova-compute[71308]:       </target>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='serial0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </serial>
Apr 14 18:48:52 user nova-compute[71308]:     <console type='pty' tty='/dev/pts/7'>
Apr 14 18:48:52 user nova-compute[71308]:       <source path='/dev/pts/7'/>
Apr 14 18:48:52 user nova-compute[71308]:       <log file='/opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/console.log' append='off'/>
Apr 14 18:48:52 user nova-compute[71308]:       <target type='serial' port='0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='serial0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </console>
Apr 14 18:48:52 user nova-compute[71308]:     <input type='mouse' bus='ps2'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='input0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </input>
Apr 14 18:48:52 user nova-compute[71308]:     <input type='keyboard' bus='ps2'>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='input1'/>
Apr 14 18:48:52 user nova-compute[71308]:     </input>
Apr 14 18:48:52 user nova-compute[71308]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 14 18:48:52 user nova-compute[71308]:       <listen type='address' address='0.0.0.0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </graphics>
Apr 14 18:48:52 user nova-compute[71308]:     <audio id='1' type='none'/>
Apr 14 18:48:52 user nova-compute[71308]:     <video>
Apr 14 18:48:52 user nova-compute[71308]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='video0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </video>
Apr 14 18:48:52 user nova-compute[71308]:     <memballoon model='virtio'>
Apr 14 18:48:52 user nova-compute[71308]:       <stats period='10'/>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='balloon0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </memballoon>
Apr 14 18:48:52 user nova-compute[71308]:     <rng model='virtio'>
Apr 14 18:48:52 user nova-compute[71308]:       <backend model='random'>/dev/urandom</backend>
Apr 14 18:48:52 user nova-compute[71308]:       <alias name='rng0'/>
Apr 14 18:48:52 user nova-compute[71308]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 18:48:52 user nova-compute[71308]:     </rng>
Apr 14 18:48:52 user nova-compute[71308]:   </devices>
Apr 14 18:48:52 user nova-compute[71308]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 18:48:52 user nova-compute[71308]:     <label>libvirt-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</label>
Apr 14 18:48:52 user nova-compute[71308]:     <imagelabel>libvirt-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99</imagelabel>
Apr 14 18:48:52 user nova-compute[71308]:   </seclabel>
Apr 14 18:48:52 user nova-compute[71308]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 18:48:52 user nova-compute[71308]:     <label>+64055:+108</label>
Apr 14 18:48:52 user nova-compute[71308]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 18:48:52 user nova-compute[71308]:   </seclabel>
Apr 14 18:48:52 user nova-compute[71308]: </domain>
Apr 14 18:48:52 user nova-compute[71308]:  {{(pid=71308) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 18:48:52 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Successfully detached device tap29934039-40 from instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 from the live domain config.
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-444984251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-444984251',id=8,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrYUmyFto3lIJuJXMBF4CtTfKVUh4V940geNTK4f4QpKuvkvp83JV/2A/URZIxQB6Rti00M04f5rrnUAVtSObiD6MPSlbY3ycoBt9DEYh9gUdRaEpFW19N4OEj4Ecmh4Q==',key_name='tempest-keypair-1208398939',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efae74f239e14c29b3af28c7fceee94d',ramdisk_id='',reservation_id='r-qypqgwqo',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2056271432',owner_user_name='tempest-TaggedAttachmentsTest-2056271432-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b083d961ab7546a7bb743d034c5e0815',uuid=e3e82a4d-89b7-4bd5-8b22-f17a019e6b99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converting VIF {"id": "29934039-40ef-4f75-a712-55b7ab72c0b0", "address": "fa:16:3e:2e:c0:5f", "network": {"id": "ddba4fb2-7f51-4d51-82b8-4eb434448f0b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-77955282", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29934039-40", "ovs_interfaceid": "29934039-40ef-4f75-a712-55b7ab72c0b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c0:5f,bridge_name='br-int',has_traffic_filtering=True,id=29934039-40ef-4f75-a712-55b7ab72c0b0,network=Network(ddba4fb2-7f51-4d51-82b8-4eb434448f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29934039-40') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG os_vif [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c0:5f,bridge_name='br-int',has_traffic_filtering=True,id=29934039-40ef-4f75-a712-55b7ab72c0b0,network=Network(ddba4fb2-7f51-4d51-82b8-4eb434448f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29934039-40') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29934039-40, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:52 user nova-compute[71308]: INFO os_vif [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:c0:5f,bridge_name='br-int',has_traffic_filtering=True,id=29934039-40ef-4f75-a712-55b7ab72c0b0,network=Network(ddba4fb2-7f51-4d51-82b8-4eb434448f0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29934039-40')
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:48:52 user nova-compute[71308]:   <nova:package version="0.0.0"/>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:name>tempest-device-tagging-server-444984251</nova:name>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:creationTime>2023-04-14 18:48:52</nova:creationTime>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:flavor name="m1.nano">
Apr 14 18:48:52 user nova-compute[71308]:     <nova:memory>128</nova:memory>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:disk>1</nova:disk>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:swap>0</nova:swap>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:vcpus>1</nova:vcpus>
Apr 14 18:48:52 user nova-compute[71308]:   </nova:flavor>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:owner>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:user uuid="b083d961ab7546a7bb743d034c5e0815">tempest-TaggedAttachmentsTest-2056271432-project-member</nova:user>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:project uuid="efae74f239e14c29b3af28c7fceee94d">tempest-TaggedAttachmentsTest-2056271432</nova:project>
Apr 14 18:48:52 user nova-compute[71308]:   </nova:owner>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:48:52 user nova-compute[71308]:   <nova:ports>
Apr 14 18:48:52 user nova-compute[71308]:     <nova:port uuid="a23ae571-1be9-4877-b629-567eb9c62b9d">
Apr 14 18:48:52 user nova-compute[71308]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 18:48:52 user nova-compute[71308]:     </nova:port>
Apr 14 18:48:52 user nova-compute[71308]:   </nova:ports>
Apr 14 18:48:52 user nova-compute[71308]: </nova:instance>
Apr 14 18:48:52 user nova-compute[71308]:  {{(pid=71308) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.compute.manager [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-changed-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.compute.manager [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing instance network info cache due to event network-changed-6690e4a9-1979-4050-a6cc-b8fb4c413d24. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] Acquiring lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] Acquired lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG nova.network.neutron [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Refreshing network info cache for port 6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:48:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquired lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG nova.network.neutron [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updated VIF entry in instance network info cache for port 6690e4a9-1979-4050-a6cc-b8fb4c413d24. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG nova.network.neutron [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [{"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ad703a5c-c00c-49f0-9c70-b28aab6db041 req-79ced371-04b8-44df-91c5-b658ae120b9c service nova] Releasing lock "refresh_cache-a3378ec4-364a-4656-ac99-500be9d40749" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocETiYjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e03adca9-8b0c-416c-943e-7dce251547c6', 'attached_at': '', 'detached_at': '', 'volume_id': '7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'serial': '7646c367-81d4-43cd-bb7a-97ecdd4f9576'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJFcgyqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'e03adca9-8b0c-416c-943e-7dce251547c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba2fc051-881a-4012-af7c-22007cc56d3b', 'serial'} {{(pid=71308) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocETiYjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:53 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:53 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:53 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4cad54-b1bc-4f96-b68f-fa605402cd9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:48:53 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[318731ab-6547-4405-925b-0d846e086535]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576] added
Apr 14 18:48:53 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0c148a-9eba-4fc9-b6a0-8839d09b2399]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[215bb0ef-d298-4a1e-a3fa-11acc4674ccc]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocETiYjG {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocETiYjG" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a213ead5-2453-454b-a036-c4c28fb00f27]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ocETiYjG'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c22e1-b630-4267-a5d1-06021f9e2ce8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[25772d75-fa3b-4ad3-ba4a-cbbcc770f1f2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:53 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:53 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e345994-1dad-4d4b-a00c-d88f3b1f5a0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576, portal: 172.16.0.220,3260]
Apr 14 18:48:53 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:53 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: INFO nova.network.neutron [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Port 29934039-40ef-4f75-a712-55b7ab72c0b0 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 14 18:48:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updating instance_info_cache with network_info: [{"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb53ca1-04f4-4f5e-9670-1f6ef1809638]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Releasing lock "refresh_cache-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[06842034-59ee-44ea-9153-36d5a844cfc5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:53 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:53 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:53 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-53ed7deb-36a0-46b8-889f-6f4efc51a5bd tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "interface-e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-29934039-40ef-4f75-a712-55b7ab72c0b0" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.691s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7572c2a8-f3fe-4af6-a388-8402ca1e6b3b]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:53 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "a3378ec4-364a-4656-ac99-500be9d40749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:54 user nova-compute[71308]: INFO nova.compute.manager [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Terminating instance
Apr 14 18:48:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-unplugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-6ec14b1f-48b2-4d38-b42c-1958689e4982 req-f5504a5e-d56c-4aa7-9836-959d9fc73f71 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-unplugged-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-unplugged-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:54 user nova-compute[71308]: WARNING nova.compute.manager [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-unplugged-29934039-40ef-4f75-a712-55b7ab72c0b0 for instance with vm_state active and task_state None.
Apr 14 18:48:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-plugged-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-plugged-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:54 user nova-compute[71308]: WARNING nova.compute.manager [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-plugged-29934039-40ef-4f75-a712-55b7ab72c0b0 for instance with vm_state active and task_state None.
Apr 14 18:48:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-43e2689d-4082-499f-99b4-4f423e335d39 req-03c7ee2e-c786-4c02-a366-b4b0bb83b4c5 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-deleted-29934039-40ef-4f75-a712-55b7ab72c0b0 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocETiYjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26233333530376263', 'path': '/dev/sdg'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233333530376263', 'path': '/dev/sdg'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG nova.objects.instance [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lazy-loading 'flavor' on Instance uuid e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-unplugged-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-2d63864b-b114-4f9e-90d2-bda250c1806a req-46a508c3-d091-40ab-8625-aa087319aec2 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-3e05363d-18d0-4fb0-9c3e-40df44246913 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 139460608 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 245366784 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:56 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Instance destroyed successfully.
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.objects.instance [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lazy-loading 'resources' on Instance uuid a3378ec4-364a-4656-ac99-500be9d40749 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:47:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ee:9b,bridge_name='br-int',has_traffic_filtering=True,id=6690e4a9-1979-4050-a6cc-b8fb4c413d24,network=Network(7745e31f-d91c-446a-a70a-50c6c684b42b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6690e4a9-19') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ee:9b,bridge_name='br-int',has_traffic_filtering=True,id=6690e4a9-1979-4050-a6cc-b8fb4c413d24,network=Network(7745e31f-d91c-446a-a70a-50c6c684b42b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6690e4a9-19') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6690e4a9-19, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: INFO os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:ee:9b,bridge_name='br-int',has_traffic_filtering=True,id=6690e4a9-1979-4050-a6cc-b8fb4c413d24,network=Network(7745e31f-d91c-446a-a70a-50c6c684b42b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6690e4a9-19')
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:47:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:81:04,bridge_name='br-int',has_traffic_filtering=True,id=83687b87-4245-4c8f-9a7e-d18dd00942d3,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83687b87-42') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:81:04,bridge_name='br-int',has_traffic_filtering=True,id=83687b87-4245-4c8f-9a7e-d18dd00942d3,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83687b87-42') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83687b87-42, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: INFO os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:81:04,bridge_name='br-int',has_traffic_filtering=True,id=83687b87-4245-4c8f-9a7e-d18dd00942d3,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap83687b87-42')
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:47:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=d30907fa-2785-4ffe-8552-7221fbff7200,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd30907fa-27') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=d30907fa-2785-4ffe-8552-7221fbff7200,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd30907fa-27') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd30907fa-27, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: INFO os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a9:e0,bridge_name='br-int',has_traffic_filtering=True,id=d30907fa-2785-4ffe-8552-7221fbff7200,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd30907fa-27')
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:47:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "address": "fa:16:3e:47:b2:fc", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e979f27-58", "ovs_interfaceid": "1e979f27-58d7-4973-b70d-f3ca1c5811c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:b2:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e979f27-58d7-4973-b70d-f3ca1c5811c5,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e979f27-58') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b2:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e979f27-58d7-4973-b70d-f3ca1c5811c5,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e979f27-58') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e979f27-58, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: WARNING nova.compute.manager [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-6690e4a9-1979-4050-a6cc-b8fb4c413d24 for instance with vm_state active and task_state deleting.
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-unplugged-d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-d30907fa-2785-4ffe-8552-7221fbff7200 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-d30907fa-2785-4ffe-8552-7221fbff7200 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: WARNING nova.compute.manager [req-41369d5d-c5ab-4ada-a20a-016bb0a34d26 req-85eb58cd-f7e7-4b0f-acff-a0ab51e3e305 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-d30907fa-2785-4ffe-8552-7221fbff7200 for instance with vm_state active and task_state deleting.
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-unplugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: WARNING nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-83687b87-4245-4c8f-9a7e-d18dd00942d3 for instance with vm_state active and task_state deleting.
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-unplugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: WARNING nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-1e979f27-58d7-4973-b70d-f3ca1c5811c5 for instance with vm_state active and task_state deleting.
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-unplugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: WARNING nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-b24d8534-70cf-4575-a8f1-f99b5e48b7db for instance with vm_state active and task_state deleting.
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-unplugged-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c388dd65-2a34-4ed1-9519-f7f2b24e307e req-49e6356c-9633-4dc5-a1ee-44b672e94a68 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-unplugged-85e8f915-2217-47d4-a9a8-74be630b2b10 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 423624704 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:57 user nova-compute[71308]: INFO os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:b2:fc,bridge_name='br-int',has_traffic_filtering=True,id=1e979f27-58d7-4973-b70d-f3ca1c5811c5,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e979f27-58')
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:47:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1b:50,bridge_name='br-int',has_traffic_filtering=True,id=3e05363d-18d0-4fb0-9c3e-40df44246913,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e05363d-18') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1b:50,bridge_name='br-int',has_traffic_filtering=True,id=3e05363d-18d0-4fb0-9c3e-40df44246913,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e05363d-18') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e05363d-18, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: INFO os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:1b:50,bridge_name='br-int',has_traffic_filtering=True,id=3e05363d-18d0-4fb0-9c3e-40df44246913,network=Network(2a955ec6-6f4e-47c7-beb3-46232e7a5baf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e05363d-18')
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:47:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bb:0e,bridge_name='br-int',has_traffic_filtering=True,id=b24d8534-70cf-4575-a8f1-f99b5e48b7db,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24d8534-70') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bb:0e,bridge_name='br-int',has_traffic_filtering=True,id=b24d8534-70cf-4575-a8f1-f99b5e48b7db,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24d8534-70') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb24d8534-70, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: INFO os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:bb:0e,bridge_name='br-int',has_traffic_filtering=True,id=b24d8534-70cf-4575-a8f1-f99b5e48b7db,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24d8534-70')
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2139810986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2139810986',id=10,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3HZ+gtzuGA+x+Hka7NtDZs3M6+ycv0+xqOtXb4rCkWleVSlwqjdX1AHt6sHXDoCu/XLut6jIDVWjvyGwUB4Hot8ZhyDEV+59XCOtvrNaMMMSCBKqzLdlwu7m8/0sBWkw==',key_name='tempest-keypair-1451762100',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72ec916e861d448a853251f522699446',ramdisk_id='',reservation_id='r-t64e5nrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-621954698',owner_user_name='tempest-TaggedBootDevicesTest-621954698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:47:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4dc36f0048042929d1230f99e2be306',uuid=a3378ec4-364a-4656-ac99-500be9d40749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converting VIF {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=85e8f915-2217-47d4-a9a8-74be630b2b10,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e8f915-22') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=85e8f915-2217-47d4-a9a8-74be630b2b10,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e8f915-22') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85e8f915-22, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: INFO os_vif [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7d:a8,bridge_name='br-int',has_traffic_filtering=True,id=85e8f915-2217-47d4-a9a8-74be630b2b10,network=Network(1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e8f915-22')
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mrawJeUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:57 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eed9b50-38dd-4d59-b072-f12e603263b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:48:57 user nova-compute[71308]: No targets found.
Apr 14 18:48:57 user nova-compute[71308]: iSNS:
Apr 14 18:48:57 user nova-compute[71308]: No targets found.
Apr 14 18:48:57 user nova-compute[71308]: STATIC:
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: FIRMWARE:
Apr 14 18:48:57 user nova-compute[71308]: No targets found.
Apr 14 18:48:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:48:57 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:48:57 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c0418c-b70e-4a80-bbbe-8aaacaba1647]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3a0f2d-c923-4274-874b-1035d95a247b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227416a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9191b08d-99ec-4a1c-b9f3-434cf16d372a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba83f156-4ed5-4d26-9552-c50226126b4d]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ed411f-228f-4283-a357-641383212854]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cfc1bd-6602-424a-864b-e81e2e88f013]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9955020f-82ce-4bc8-9836-1decb914b7bb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 598736896 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:57 user nova-compute[71308]: WARNING nova.compute.manager [req-b1a90199-fcbd-4f70-af35-ccd0769f738c req-0821731c-f3af-4ea4-84b5-a75304ece7a3 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-3e05363d-18d0-4fb0-9c3e-40df44246913 for instance with vm_state active and task_state deleting.
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f149cbe9-7422-4d82-b870-b2ae54356046]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019, portal: 172.16.0.220,3260]
Apr 14 18:48:57 user nova-compute[71308]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ec2c8d4-acb4-4707-937f-3834d2130019 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e4f87b-2cd8-4fee-b5fe-bac5d609d86a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] <== disconnect_volume: return (455ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpPOxfsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:57 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ac02b3-0ce2-4784-b18a-5d260ecdc3ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:48:57 user nova-compute[71308]: No targets found.
Apr 14 18:48:57 user nova-compute[71308]: iSNS:
Apr 14 18:48:57 user nova-compute[71308]: No targets found.
Apr 14 18:48:57 user nova-compute[71308]: STATIC:
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:48:57 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:57 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:57 user nova-compute[71308]: FIRMWARE:
Apr 14 18:48:57 user nova-compute[71308]: No targets found.
Apr 14 18:48:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:48:57 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:48:57 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eed406c-054b-44d0-a623-c5f7a6bcbf91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4650679a-d13f-4d57-96f9-1d065adc917b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:57 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22741680d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbfbd89-6690-443d-9b77-4eb2f494ae35]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c57f14-5cf0-4e01-8ad3-f4c6983b079c]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c3551b-9da4-4982-bb1b-39450e2101d4]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:48:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3684641f-b3c6-4ff1-986b-d2c7e4e6c648]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d25914-eede-46e1-8288-952d1437960f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 769654784 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b171c6-3e16-47eb-90cc-c5a89def8488]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786, portal: 172.16.0.220,3260]
Apr 14 18:48:58 user nova-compute[71308]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:58 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382a8e93-fd2e-41aa-b8a2-b2458e16c786 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cb9050-bbb9-481e-a9aa-715e89767c25]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] <== disconnect_volume: return (485ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HANrcBMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:58 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8a5450-6007-49b8-8404-49b62a5fbb02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:48:58 user nova-compute[71308]: No targets found.
Apr 14 18:48:58 user nova-compute[71308]: iSNS:
Apr 14 18:48:58 user nova-compute[71308]: No targets found.
Apr 14 18:48:58 user nova-compute[71308]: STATIC:
Apr 14 18:48:58 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b
Apr 14 18:48:58 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:58 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:58 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca
Apr 14 18:48:58 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:58 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:58 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576
Apr 14 18:48:58 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:58 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:58 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:48:58 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:58 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:58 user nova-compute[71308]: FIRMWARE:
Apr 14 18:48:58 user nova-compute[71308]: No targets found.
Apr 14 18:48:58 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:48:58 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:48:58 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55a013f-7a80-4da6-9d43-3ad46377ca33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe720756-58de-4810-a3f3-646b3b4a8536]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:58 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:58 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:58 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:58 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:58 user nova-compute[71308]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca (non-flash)
Apr 14 18:48:58 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:58 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:58 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2254111240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca'): ({'sdd'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Removing single pathed devices sdd {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[821be4d6-98de-4220-9377-634bf2dea393]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bb14e9-0357-4f55-816c-6d0288db8305]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Flushing IO for device /dev/sdd {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e43cdac-bd21-4157-b8fc-cf8cdaa30ff4]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ea791f-05ad-4ba3-a9bd-b25fa795d641]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] SCSI volumes sdd have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[647e24c9-e788-4807-9f05-2b9f8507b4f5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498123.4941373, 499df49b-4a00-447b-bd2f-b027fb44f3b8 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:48:58 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] VM Stopped (Lifecycle Event)
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c9e41a30-629f-415a-b0ee-1596692d25da None None] [instance: 499df49b-4a00-447b-bd2f-b027fb44f3b8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e84b434-3a0d-47e4-8f0c-fb32efcea6bc]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca, portal: 172.16.0.220,3260]
Apr 14 18:48:58 user nova-compute[71308]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:58 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:330b8b4e-5b68-43de-b1fb-f661060cc9ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9bd6ab-c50a-4ecc-9f61-032b4ec36645]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] <== disconnect_volume: return (389ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:48:58 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Deleting instance files /opt/stack/data/nova/instances/a3378ec4-364a-4656-ac99-500be9d40749_del
Apr 14 18:48:58 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Deletion of /opt/stack/data/nova/instances/a3378ec4-364a-4656-ac99-500be9d40749_del complete
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 936378368 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:58 user nova-compute[71308]: INFO nova.compute.manager [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Took 4.09 seconds to destroy the instance on the hypervisor.
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: a3378ec4-364a-4656-ac99-500be9d40749] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-plugged-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] Acquiring lock "a3378ec4-364a-4656-ac99-500be9d40749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] Lock "a3378ec4-364a-4656-ac99-500be9d40749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] No waiting events found dispatching network-vif-plugged-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:48:59 user nova-compute[71308]: WARNING nova.compute.manager [req-b9464600-9fb4-4c82-afb6-743968e01ba1 req-7b18b368-d864-4a01-8d6f-ef0e49077a88 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received unexpected event network-vif-plugged-85e8f915-2217-47d4-a9a8-74be630b2b10 for instance with vm_state active and task_state deleting.
Apr 14 18:48:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJFcgyqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:48:59 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[57274c73-99e5-4b1d-bf1f-e358af8a5a05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:48:59 user nova-compute[71308]: No targets found.
Apr 14 18:48:59 user nova-compute[71308]: iSNS:
Apr 14 18:48:59 user nova-compute[71308]: No targets found.
Apr 14 18:48:59 user nova-compute[71308]: STATIC:
Apr 14 18:48:59 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b
Apr 14 18:48:59 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:59 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:59 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576
Apr 14 18:48:59 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:59 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:59 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:48:59 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:48:59 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:48:59 user nova-compute[71308]: FIRMWARE:
Apr 14 18:48:59 user nova-compute[71308]: No targets found.
Apr 14 18:48:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:48:59 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:48:59 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca542d0-d1db-4e6a-ad8f-6aa3f8938519]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3425895-aa76-491c-b0b0-176aeb886593]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:59 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:59 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:48:59 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:48:59 user nova-compute[71308]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:48:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227a9ef130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b'): ({'sdf'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Removing single pathed devices sdf {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid 'a3378ec4-364a-4656-ac99-500be9d40749' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a3378ec4-364a-4656-ac99-500be9d40749' (instance-0000000a)
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb7d3e2-d754-41eb-9380-419a301c6115]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a5245b-74c4-4c73-a193-464fc31d1519]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Flushing IO for device /dev/sdf {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4dca54-f959-491e-ae9d-b24317df3dfc]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e1aad2-2542-4302-90ca-13778827845f]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[878ccda7-c27f-47d6-8022-c1706af36908]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b586a2-100d-440f-9a9c-b11c7a10de63]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260]
Apr 14 18:48:59 user nova-compute[71308]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260] successful.
Apr 14 18:48:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9076a23-2f49-491a-8605-f4162f823b92]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] <== disconnect_volume: return (368ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocETiYjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e03adca9-8b0c-416c-943e-7dce251547c6', 'attached_at': '', 'detached_at': '', 'volume_id': '7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'serial'} {{(pid=71308) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] swap_volume: removing Cinder connection for volume ba2fc051-881a-4012-af7c-22007cc56d3b {{(pid=71308) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:48:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.manager [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] swap_volume: Updating volume ba2fc051-881a-4012-af7c-22007cc56d3b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ocETiYjG", "auth_password": "or0TVf6NXP2Q43", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "7646c367-81d4-43cd-bb7a-97ecdd4f9576"}, "status": "reserved", "instance": "e03adca9-8b0c-416c-943e-7dce251547c6", "attached_at": "", "detached_at": "", "volume_id": "7646c367-81d4-43cd-bb7a-97ecdd4f9576", "serial": "7646c367-81d4-43cd-bb7a-97ecdd4f9576"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'no_device': None, 'attachment_id': '81fca13d-21a5-44aa-b628-68a2e7e167b6'} {{(pid=71308) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 18:49:00 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:49:00 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7517MB free_disk=26.496360778808594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0c3c45a2-bc68-4ebb-9bf2-f4811f4eb40e tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.070s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 094a4a33-569e-4137-8798-743499f1046c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 817f112c-d806-4800-9e4a-a3892c54bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance e03adca9-8b0c-416c-943e-7dce251547c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a3378ec4-364a-4656-ac99-500be9d40749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:49:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-deleted-1e979f27-58d7-4973-b70d-f3ca1c5811c5 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:01 user nova-compute[71308]: INFO nova.compute.manager [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Neutron deleted interface 1e979f27-58d7-4973-b70d-f3ca1c5811c5; detaching it from the instance and deleting it from the info cache
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.network.neutron [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [{"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e05363d-18d0-4fb0-9c3e-40df44246913", "address": "fa:16:3e:9e:1b:50", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e05363d-18", "ovs_interfaceid": "3e05363d-18d0-4fb0-9c3e-40df44246913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-4889b6ae-15d4-4de7-a41c-7a0a0893f3e8 req-c1f0352d-a3b8-48e9-8313-3f7dda694aef service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Detach interface failed, port_id=1e979f27-58d7-4973-b70d-f3ca1c5811c5, reason: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.386s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:49:01 user nova-compute[71308]: INFO nova.compute.claims [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Claim successful on node user
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:49:01 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:49:02 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:49:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:49:02 user nova-compute[71308]: INFO nova.virt.block_device [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Booting with blank volume at /dev/vda
Apr 14 18:49:02 user nova-compute[71308]: DEBUG nova.policy [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG os_brick.utils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d74f04-3f87-46d2-ae77-3291b51f55c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30a3ef9-2374-4ce6-a3b7-5b6fb11b4108]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[076c525d-54d3-4662-8985-0ab17d94a17e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df4a2e4-7676-4755-9b32-a71ee0427d16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:02 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:49:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bfca3c-5227-4395-95a0-58c743dd0616]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG os_brick.utils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:02 user nova-compute[71308]: INFO nova.compute.manager [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Swapping volume 7646c367-81d4-43cd-bb7a-97ecdd4f9576 for ba2fc051-881a-4012-af7c-22007cc56d3b
Apr 14 18:49:02 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Successfully created port: b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:49:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-deleted-3e05363d-18d0-4fb0-9c3e-40df44246913 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:03 user nova-compute[71308]: INFO nova.compute.manager [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Neutron deleted interface 3e05363d-18d0-4fb0-9c3e-40df44246913; detaching it from the instance and deleting it from the info cache
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.network.neutron [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [{"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "address": "fa:16:3e:e0:bb:0e", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24d8534-70", "ovs_interfaceid": "b24d8534-70cf-4575-a8f1-f99b5e48b7db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Detach interface failed, port_id=3e05363d-18d0-4fb0-9c3e-40df44246913, reason: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-deleted-b24d8534-70cf-4575-a8f1-f99b5e48b7db {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:03 user nova-compute[71308]: INFO nova.compute.manager [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Neutron deleted interface b24d8534-70cf-4575-a8f1-f99b5e48b7db; detaching it from the instance and deleting it from the info cache
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.network.neutron [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [{"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "85e8f915-2217-47d4-a9a8-74be630b2b10", "address": "fa:16:3e:c4:7d:a8", "network": {"id": "1266fbaa-0f51-4a09-a2b6-172cc2a2ab9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-497325283", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e8f915-22", "ovs_interfaceid": "85e8f915-2217-47d4-a9a8-74be630b2b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Detach interface failed, port_id=b24d8534-70cf-4575-a8f1-f99b5e48b7db, reason: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-deleted-85e8f915-2217-47d4-a9a8-74be630b2b10 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:03 user nova-compute[71308]: INFO nova.compute.manager [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Neutron deleted interface 85e8f915-2217-47d4-a9a8-74be630b2b10; detaching it from the instance and deleting it from the info cache
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.network.neutron [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [{"id": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "address": "fa:16:3e:f8:ee:9b", "network": {"id": "7745e31f-d91c-446a-a70a-50c6c684b42b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2063432365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6690e4a9-19", "ovs_interfaceid": "6690e4a9-1979-4050-a6cc-b8fb4c413d24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "address": "fa:16:3e:c4:81:04", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83687b87-42", "ovs_interfaceid": "83687b87-4245-4c8f-9a7e-d18dd00942d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d30907fa-2785-4ffe-8552-7221fbff7200", "address": "fa:16:3e:7e:a9:e0", "network": {"id": "2a955ec6-6f4e-47c7-beb3-46232e7a5baf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1132088583", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "72ec916e861d448a853251f522699446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd30907fa-27", "ovs_interfaceid": "d30907fa-2785-4ffe-8552-7221fbff7200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-2af04671-28b6-44d2-90f2-49b61460c7fd req-43985ec7-58e0-48ce-8f89-c764f97f8941 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Detach interface failed, port_id=85e8f915-2217-47d4-a9a8-74be630b2b10, reason: Instance a3378ec4-364a-4656-ac99-500be9d40749 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] Updating instance_info_cache with network_info: [{"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-094a4a33-569e-4137-8798-743499f1046c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:03 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Took 4.92 seconds to deallocate network for instance.
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Successfully updated port: b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquired lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-changed-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Refreshing instance network info cache due to event network-changed-b8044678-899b-4461-bbf0-cf9fd662e71e. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] Acquiring lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:49:03 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:49:04 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updating instance_info_cache with network_info: [{"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Releasing lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:49:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Instance network_info: |[{"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:49:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] Acquired lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:49:04 user nova-compute[71308]: DEBUG nova.network.neutron [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Refreshing network info cache for port b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:49:04 user nova-compute[71308]: DEBUG nova.network.neutron [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updated VIF entry in instance network info cache for port b8044678-899b-4461-bbf0-cf9fd662e71e. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:49:04 user nova-compute[71308]: DEBUG nova.network.neutron [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updating instance_info_cache with network_info: [{"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fb3c161a-06d3-431b-b50f-dd97a9d0bd3f req-ea924ac8-8c42-4121-b953-38be1b116a14 service nova] Releasing lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:49:05 user nova-compute[71308]: DEBUG nova.compute.manager [req-9ca19098-b0bf-465e-8324-6c263109fd8c req-6f423059-cb8f-4743-857a-4e1b2cd35a26 service nova] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Received event network-vif-deleted-6690e4a9-1979-4050-a6cc-b8fb4c413d24 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:06 user nova-compute[71308]: INFO nova.compute.manager [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Took 2.60 seconds to detach 3 volumes for instance.
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG nova.objects.instance [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'flavor' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:06 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Deleted allocations for instance a3378ec4-364a-4656-ac99-500be9d40749
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:06 user nova-compute[71308]: INFO nova.compute.manager [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Attaching volume 31ad3520-e4ab-4564-8a4f-b1f9afc6d344 to /dev/vdb
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-adcee807-e2dd-4d64-937f-ff2cc5742d60 tempest-TaggedBootDevicesTest-621954698 tempest-TaggedBootDevicesTest-621954698-project-member] Lock "a3378ec4-364a-4656-ac99-500be9d40749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.295s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG os_brick.utils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd5f04c-5086-452f-a58b-ac873a3ee145]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dc6b0d-d33a-42ec-ad8e-3557ceb11fc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[515bc4fd-241b-4a03-9804-e42ff84b5eb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe48be5-9987-4d7c-bb77-28fd06dd8ffb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:07 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca0d1e1-8c71-4d68-9060-c579c7fd9c51]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.utils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updating existing volume attachment record: e5618417-c893-4a3a-8299-ddf2d9b4dcdb {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJFcgyqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e03adca9-8b0c-416c-943e-7dce251547c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba2fc051-881a-4012-af7c-22007cc56d3b', 'serial': 'ba2fc051-881a-4012-af7c-22007cc56d3b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocETiYjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '7646c367-81d4-43cd-bb7a-97ecdd4f9576'}, 'status': 'reserved', 'instance': 'e03adca9-8b0c-416c-943e-7dce251547c6', 'attached_at': '', 'detached_at': '', 'volume_id': '7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'serial'} {{(pid=71308) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJFcgyqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:07 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:07 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:07 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[598cc35b-70ee-4ff9-aa5f-51e5cf29ac95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:49:07 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bb9cae-a125-44d8-a1ba-1fb50ac5d6bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b] added
Apr 14 18:49:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3033ac4-d2e0-4a00-8c2f-20ed684a09ec]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.utils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87b15f6-98af-4052-bc79-e440402fed28]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJFcgyqi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13a65a4-1537-49b2-95b2-5702f8ef86b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJFcgyqi" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf658187-8bb7-49a2-a0ae-f6241caca503]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJFcgyqi'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aaf2df-1773-4eef-b805-323e0e10ddd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[854cd8c2-578f-4dca-937b-9743060aa6ae]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1e03b5-7b18-4ce5-a899-7a1cbaac0495]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9565520-1dd4-48a5-a2b3-5389ba028cf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[348d8aaf-2541-405f-8e1b-99ac9ca989e8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:07 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:07 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:07 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:49:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[348d137d-da85-450f-bc7c-d634a185f15e]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG os_brick.utils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:07 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updating existing volume attachment record: a3e459f5-bcdc-4d94-a036-61785cc2372e {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c4718c-bbcd-49e9-be37-295fc5e76e64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260]
Apr 14 18:49:08 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:08 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[65472970-fa72-4876-8776-ff861f88a4e5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[14369557-6e86-4b71-9159-8f8790768a5d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:08 user nova-compute[71308]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:08 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:08 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:08 user nova-compute[71308]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:08 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:08 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e40f8ba-19c5-4b93-94a5-4f2c551c14e8]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:49:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJFcgyqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:49:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23366616166613263', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366616166613263', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:49:09 user nova-compute[71308]: DEBUG nova.objects.instance [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lazy-loading 'flavor' on Instance uuid e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:09 user nova-compute[71308]: DEBUG nova.objects.instance [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'flavor' on Instance uuid 2c4f47d7-95da-4a01-b6e6-eb14933fede7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Ignoring supplied device name: /dev/vdb
Apr 14 18:49:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:10 user nova-compute[71308]: INFO nova.compute.manager [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Attaching volume 2b5b5249-f5b0-4713-81d6-7593e5705ae1 to /dev/vdb
Apr 14 18:49:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 171966464 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG os_brick.utils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e31cc6-2977-4077-ba5d-010ff1e20168]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49c5ea5-0030-4098-a5f2-78487aba9765]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfcaf2b-4ada-4c4c-a18d-9fcbd9629f34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7650baed-475c-44c2-ad4d-decf3921451b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:10 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:49:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5770e4fd-34de-4a40-bc31-e6d9a40034b2]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG os_brick.utils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Updating existing volume attachment record: 70529658-be7a-43fe-a195-db449bac2344 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:49:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 337641472 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:49:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 440401920 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:49:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 553648128 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:49:11 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498136.6720552, a3378ec4-364a-4656-ac99-500be9d40749 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:11 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: a3378ec4-364a-4656-ac99-500be9d40749] VM Stopped (Lifecycle Event)
Apr 14 18:49:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e776da65-2a79-4690-81ed-ce96420921dc None None] [instance: a3378ec4-364a-4656-ac99-500be9d40749] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 718274560 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 857735168 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkIoRtub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:12 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:12 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:12 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ded10c-9cd8-49f2-95cc-1a92a80b35f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:49:12 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff4344-a6c2-4934-9140-52ca40ef604f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344] added
Apr 14 18:49:12 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca57ed58-2841-4900-879f-560eff865b73]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c51a8c-5007-4663-a12a-eb73c7a4d9b9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkIoRtub {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG nova.objects.instance [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'flavor' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkIoRtub" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a3f35b-98f6-4f00-a6d9-c7c4b41fbaa6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qkIoRtub'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e02ecd0-6a2e-4398-a2a4-e6d4f78f1294]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4511d06-e0bf-476f-9eb4-4009b68c5f94]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:13 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:13 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 1018167296 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260f6f1-c720-4a6a-a3e9-ee4c26e3e589]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260]
Apr 14 18:49:13 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:13 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4338811-9890-43f5-8b0f-4df04b853574]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c91137-5d82-40ae-807a-224ce5f4cc21]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:13 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:13 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:13 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97c8d5c-23f8-496f-8d5e-ae1f52b414e4]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:13 user nova-compute[71308]: INFO nova.compute.manager [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attaching volume ced25197-205e-4821-82f2-1f37e41f5993 to /dev/vdb
Apr 14 18:49:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocETiYjG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '7646c367-81d4-43cd-bb7a-97ecdd4f9576': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:13 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG os_brick.utils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[582028fa-2622-413d-86f1-624810364ae0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[623afe59-2558-4530-b54c-50826114d710]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[41df8e5d-8f7a-44c7-bbff-b30a3a181bfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba905018-5d2c-4d28-bd60-8ac2db907d36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:14 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21bb170-9f10-4de5-b154-1f84cf26de1f]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.utils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating existing volume attachment record: b11bebcc-ecc1-47ca-ad54-0bee377b3393 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:49:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Creating image(s)
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Ensure instance console log exists: /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Start _get_guest_xml network_info=[{"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'a3e459f5-bcdc-4d94-a036-61785cc2372e', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qosgFUfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23d14a51-41aa-4827-bd60-c605d9689bc8', 'attached_at': '', 'detached_at': '', 'volume_id': '45b3dec9-bffa-4042-b85b-b8f6620c5955', 'serial': '45b3dec9-bffa-4042-b85b-b8f6620c5955'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:49:14 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:49:14 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qosgFUfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:14 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkIoRtub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '23636333235383366', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636333235383366', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.532s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'flavor' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de2e1c3-487f-4301-af46-53a4f9c42634]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:49:14 user nova-compute[71308]: No targets found.
Apr 14 18:49:14 user nova-compute[71308]: iSNS:
Apr 14 18:49:14 user nova-compute[71308]: No targets found.
Apr 14 18:49:14 user nova-compute[71308]: STATIC:
Apr 14 18:49:14 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:49:14 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:14 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:14 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b
Apr 14 18:49:14 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:14 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:14 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576
Apr 14 18:49:14 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:14 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:14 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:49:14 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:14 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:14 user nova-compute[71308]: FIRMWARE:
Apr 14 18:49:14 user nova-compute[71308]: No targets found.
Apr 14 18:49:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:49:14 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:49:14 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:49:14 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:14 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:49:14 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:49:14 user nova-compute[71308]:   <serial>31ad3520-e4ab-4564-8a4f-b1f9afc6d344</serial>
Apr 14 18:49:14 user nova-compute[71308]: </disk>
Apr 14 18:49:14 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b9b002-fddb-476e-9f48-9e3afd089b04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[795efd99-7118-4acc-a382-e3fbbeb23352]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aaa7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576'): ({'sdg'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Removing single pathed devices sdg {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12279b4-74d5-45b3-9fa2-d3507ff7a900]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e72937-b8ae-422e-817e-0a870a9b6342]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Flushing IO for device /dev/sdg {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3566e8f-5e5a-4332-acc0-c32120ebddf5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a026049c-b644-4516-9da8-90c7eb3399a4]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbadd8dc-5c88-4c2d-8841-3ac3879e99b2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e93182f-55f6-437a-8afc-db19b2caa232]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576, portal: 172.16.0.220,3260]
Apr 14 18:49:14 user nova-compute[71308]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7646c367-81d4-43cd-bb7a-97ecdd4f9576 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35bf2be-46b8-4b1f-8a4f-6ba16309b7a6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] <== disconnect_volume: return (876ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.357s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:14 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:14 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c84ce6-ec12-4419-9b84-c78e0420631d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:49:14 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[352a75c5-ad45-451e-a239-b43b23c21906]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955] added
Apr 14 18:49:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aae4a8c-e787-4d30-980f-2480708a2e2b]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[58645519-9e73-49bd-bf43-b064c41982c4]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qosgFUfc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJFcgyqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e03adca9-8b0c-416c-943e-7dce251547c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba2fc051-881a-4012-af7c-22007cc56d3b', 'serial'} {{(pid=71308) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] swap_volume: removing Cinder connection for volume 7646c367-81d4-43cd-bb7a-97ecdd4f9576 {{(pid=71308) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qosgFUfc" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f2e537-19d3-4150-b3a5-2fa80f085b5c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qosgFUfc'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[358a11f2-5b0a-4328-bdd7-8915bfce1762]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e175f4a-f82c-4fbc-87dc-45069808c9d2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:14 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No VIF found with MAC fa:16:3e:75:42:3b, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7897c7c-00e5-4a72-878c-3b2175b3f5d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955, portal: 172.16.0.220,3260]
Apr 14 18:49:14 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[895fb23b-2a87-45bb-a41b-8a69f8baeb5c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[648c7f3f-7b50-45fb-b3a2-b93f007abc11]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:15 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:15 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:15 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:15 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:15 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:15 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:15 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:15 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[13548c77-1c7f-40ac-b9b7-2871677f50ce]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qosgFUfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] swap_volume: Updating volume 7646c367-81d4-43cd-bb7a-97ecdd4f9576 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "zJFcgyqi", "auth_password": "GfU2x1JXQOdgAW", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "ba2fc051-881a-4012-af7c-22007cc56d3b"}, "status": "reserved", "instance": "e03adca9-8b0c-416c-943e-7dce251547c6", "attached_at": "", "detached_at": "", "volume_id": "ba2fc051-881a-4012-af7c-22007cc56d3b", "serial": "ba2fc051-881a-4012-af7c-22007cc56d3b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ba2fc051-881a-4012-af7c-22007cc56d3b', 'no_device': None, 'attachment_id': 'fb30d976-a65e-47c1-95dc-f7b8f0597a74'} {{(pid=71308) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9e5f2f33-051a-4ad7-88f6-6724544f4a8d tempest-TestVolumeSwap-1488684766 tempest-TestVolumeSwap-1488684766-project-admin] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.286s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INZtFGds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:15 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-437e2c10-cbc8-46bc-8ddc-81e9e58545d1 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.970s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] <== connect_volume: return (1715ms) {'type': 'block', 'scsi_wwn': '26364333331306538', 'path': '/dev/sdd'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364333331306538', 'path': '/dev/sdd'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.289s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:16 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:16 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219397521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219397521',id=14,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-8vhrdkcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:49:02Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=23d14a51-41aa-4827-bd60-c605d9689bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:27:c8,bridge_name='br-int',has_traffic_filtering=True,id=b8044678-899b-4461-bbf0-cf9fd662e71e,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8044678-89') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.objects.instance [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'pci_devices' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5df07f9-3464-4a2c-a4fc-fc9f1039435d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:49:16 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:49:16 user nova-compute[71308]:   <uuid>23d14a51-41aa-4827-bd60-c605d9689bc8</uuid>
Apr 14 18:49:16 user nova-compute[71308]:   <name>instance-0000000e</name>
Apr 14 18:49:16 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:49:16 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:49:16 user nova-compute[71308]:   <metadata>
Apr 14 18:49:16 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:49:16 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:49:16 user nova-compute[71308]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1219397521</nova:name>
Apr 14 18:49:16 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:49:14</nova:creationTime>
Apr 14 18:49:16 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:49:16 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:49:16 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:49:16 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:49:16 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:49:16 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:49:16 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:49:16 user nova-compute[71308]:       <nova:owner>
Apr 14 18:49:16 user nova-compute[71308]:         <nova:user uuid="a644b8bb9b90494ba670da8315bfe005">tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member</nova:user>
Apr 14 18:49:16 user nova-compute[71308]:         <nova:project uuid="424e732759884efa8fd126cd9a082c8a">tempest-ServerBootFromVolumeStableRescueTest-1815450365</nova:project>
Apr 14 18:49:16 user nova-compute[71308]:       </nova:owner>
Apr 14 18:49:16 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:49:16 user nova-compute[71308]:       <nova:ports>
Apr 14 18:49:16 user nova-compute[71308]:         <nova:port uuid="b8044678-899b-4461-bbf0-cf9fd662e71e">
Apr 14 18:49:16 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 18:49:16 user nova-compute[71308]:         </nova:port>
Apr 14 18:49:16 user nova-compute[71308]:       </nova:ports>
Apr 14 18:49:16 user nova-compute[71308]:     </nova:instance>
Apr 14 18:49:16 user nova-compute[71308]:   </metadata>
Apr 14 18:49:16 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:49:16 user nova-compute[71308]:     <system>
Apr 14 18:49:16 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:49:16 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:49:16 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:49:16 user nova-compute[71308]:       <entry name="serial">23d14a51-41aa-4827-bd60-c605d9689bc8</entry>
Apr 14 18:49:16 user nova-compute[71308]:       <entry name="uuid">23d14a51-41aa-4827-bd60-c605d9689bc8</entry>
Apr 14 18:49:16 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:49:16 user nova-compute[71308]:     </system>
Apr 14 18:49:16 user nova-compute[71308]:   </sysinfo>
Apr 14 18:49:16 user nova-compute[71308]:   <os>
Apr 14 18:49:16 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:49:16 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:49:16 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:49:16 user nova-compute[71308]:   </os>
Apr 14 18:49:16 user nova-compute[71308]:   <features>
Apr 14 18:49:16 user nova-compute[71308]:     <acpi/>
Apr 14 18:49:16 user nova-compute[71308]:     <apic/>
Apr 14 18:49:16 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:49:16 user nova-compute[71308]:   </features>
Apr 14 18:49:16 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:49:16 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:49:16 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:49:16 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:49:16 user nova-compute[71308]:   </clock>
Apr 14 18:49:16 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:49:16 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:49:16 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:49:16 user nova-compute[71308]:   </cpu>
Apr 14 18:49:16 user nova-compute[71308]:   <devices>
Apr 14 18:49:16 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:49:16 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:16 user nova-compute[71308]:       <source dev="/dev/sdd"/>
Apr 14 18:49:16 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:49:16 user nova-compute[71308]:       <serial>45b3dec9-bffa-4042-b85b-b8f6620c5955</serial>
Apr 14 18:49:16 user nova-compute[71308]:     </disk>
Apr 14 18:49:16 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:49:16 user nova-compute[71308]:       <mac address="fa:16:3e:90:27:c8"/>
Apr 14 18:49:16 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:49:16 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:49:16 user nova-compute[71308]:       <target dev="tapb8044678-89"/>
Apr 14 18:49:16 user nova-compute[71308]:     </interface>
Apr 14 18:49:16 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:49:16 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/console.log" append="off"/>
Apr 14 18:49:16 user nova-compute[71308]:     </serial>
Apr 14 18:49:16 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:49:16 user nova-compute[71308]:     <video>
Apr 14 18:49:16 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:49:16 user nova-compute[71308]:     </video>
Apr 14 18:49:16 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:49:16 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:49:16 user nova-compute[71308]:     </rng>
Apr 14 18:49:16 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:49:16 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:49:16 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:49:16 user nova-compute[71308]:     </memballoon>
Apr 14 18:49:16 user nova-compute[71308]:   </devices>
Apr 14 18:49:16 user nova-compute[71308]: </domain>
Apr 14 18:49:16 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219397521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219397521',id=14,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-8vhrdkcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:49:02Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=23d14a51-41aa-4827-bd60-c605d9689bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:27:c8,bridge_name='br-int',has_traffic_filtering=True,id=b8044678-899b-4461-bbf0-cf9fd662e71e,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8044678-89') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_vif [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:27:c8,bridge_name='br-int',has_traffic_filtering=True,id=b8044678-899b-4461-bbf0-cf9fd662e71e,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8044678-89') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9502de21-39f5-4432-856b-67eb35f2dfb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1] added
Apr 14 18:49:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8044678-89, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8044678-89, col_values=(('external_ids', {'iface-id': 'b8044678-899b-4461-bbf0-cf9fd662e71e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:27:c8', 'vm-uuid': '23d14a51-41aa-4827-bd60-c605d9689bc8'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:16 user nova-compute[71308]: INFO os_vif [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:27:c8,bridge_name='br-int',has_traffic_filtering=True,id=b8044678-899b-4461-bbf0-cf9fd662e71e,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8044678-89')
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02796be-a261-4e63-872f-03743f6b043e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[868b2d58-42e3-433c-861d-77cebe0ec473]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INZtFGds {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No VIF found with MAC fa:16:3e:90:27:c8, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INZtFGds" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6376134-aa67-4563-88cb-c0680cff8c99]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'INZtFGds'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[df02bf7d-bf31-4492-bf70-652f1f92c4e1]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c07378-7177-4be4-853d-b06151fe05dc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[74918214-a15d-46ad-80f2-16f05d8205c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1, portal: 172.16.0.220,3260]
Apr 14 18:49:16 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[850bba93-4cbf-441e-9551-2dad5fa82524]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[59537764-79a1-4c0e-82bd-de77c429f1ca]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:16 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd7faf1-ac0b-44a0-b449-9d9a3749c5c4]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INZtFGds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:16 user nova-compute[71308]: INFO nova.compute.manager [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Detaching volume ba2fc051-881a-4012-af7c-22007cc56d3b
Apr 14 18:49:16 user nova-compute[71308]: INFO nova.virt.block_device [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Attempting to driver detach volume ba2fc051-881a-4012-af7c-22007cc56d3b from mountpoint /dev/vdb
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Attempting to detach device vdb from instance e03adca9-8b0c-416c-943e-7dce251547c6 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:49:16 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:16 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 18:49:16 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:49:16 user nova-compute[71308]:   <serial>ba2fc051-881a-4012-af7c-22007cc56d3b</serial>
Apr 14 18:49:16 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:49:16 user nova-compute[71308]: </disk>
Apr 14 18:49:16 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:49:16 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Successfully detached device vdb from instance e03adca9-8b0c-416c-943e-7dce251547c6 from the persistent domain config.
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e03adca9-8b0c-416c-943e-7dce251547c6 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:49:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:49:16 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:16 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 18:49:16 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:49:16 user nova-compute[71308]:   <serial>ba2fc051-881a-4012-af7c-22007cc56d3b</serial>
Apr 14 18:49:16 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:49:16 user nova-compute[71308]: </disk>
Apr 14 18:49:16 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498157.1838772, e03adca9-8b0c-416c-943e-7dce251547c6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:49:17 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Successfully detached device vdb from instance e03adca9-8b0c-416c-943e-7dce251547c6 from the live domain config.
Apr 14 18:49:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJFcgyqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'ba2fc051-881a-4012-af7c-22007cc56d3b': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:17 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] <== connect_volume: return (1766ms) {'type': 'block', 'scsi_wwn': '26166643134343039', 'path': '/dev/sdf'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166643134343039', 'path': '/dev/sdf'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.364s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG nova.objects.instance [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'flavor' on Instance uuid 2c4f47d7-95da-4a01-b6e6-eb14933fede7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8989084c-e849-4335-80e3-6d7449038d81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:49:17 user nova-compute[71308]: No targets found.
Apr 14 18:49:17 user nova-compute[71308]: iSNS:
Apr 14 18:49:17 user nova-compute[71308]: No targets found.
Apr 14 18:49:17 user nova-compute[71308]: STATIC:
Apr 14 18:49:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:49:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b
Apr 14 18:49:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1
Apr 14 18:49:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:49:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:49:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:17 user nova-compute[71308]: FIRMWARE:
Apr 14 18:49:17 user nova-compute[71308]: No targets found.
Apr 14 18:49:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:49:17 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:49:17 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:49:17 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:17 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:49:17 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:49:17 user nova-compute[71308]:   <serial>2b5b5249-f5b0-4713-81d6-7593e5705ae1</serial>
Apr 14 18:49:17 user nova-compute[71308]: </disk>
Apr 14 18:49:17 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3282f59c-c714-4906-a6ac-cd7e459cae74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f605a43-c70f-4d06-8641-39d71fb338f0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:17 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:17 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:17 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:17 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b (non-flash)
Apr 14 18:49:17 user nova-compute[71308]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:17 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:17 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:17 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f226c225870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2629462f-4e35-4253-a56b-daaf7a4a3f50]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a07c119-14cf-43c7-a620-cc2cbc549869]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5371a055-8510-4a49-a5c1-ac53cadbefda]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5010a597-f909-4b41-be4b-979acdb4861f]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[73308890-9222-4c3d-9663-5f3f6c684739]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f07e3e-5f26-4e0a-b917-b18620bd6928]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260]
Apr 14 18:49:17 user nova-compute[71308]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba2fc051-881a-4012-af7c-22007cc56d3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad05dc7b-378a-4c61-9c7a-e3c34ab3b44a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] <== disconnect_volume: return (696ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:49:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:18 user nova-compute[71308]: WARNING nova.compute.manager [req-60e6a994-92e6-4330-8e7f-3f374d655534 req-192cca24-f63e-42ec-8cc8-b3da2b899b56 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state building and task_state spawning.
Apr 14 18:49:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No VIF found with MAC fa:16:3e:32:f6:3d, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-97b1b7ef-f0f7-4554-8ef6-ec7b84821103 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.385s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lazy-loading 'flavor' on Instance uuid e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2e04658-d636-4fde-9509-5f05dcba0c58 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.310s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBYpCkVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:19 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:19 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:19 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[047f45ad-b214-4331-9511-10aae35f8048]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:49:19 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8531c50e-f01a-4a12-ac31-e3d4d4949d97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993] added
Apr 14 18:49:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4f81f6-de3c-462c-abf9-98d260205deb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e912ba7-e715-42ad-98ea-eed9e78c235c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qBYpCkVj {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qBYpCkVj" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce66302-7ae5-4920-9c0b-5c9bceac94ec]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qBYpCkVj'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5be087f-db81-437c-815c-58b7c0ffc4a1]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfd9059-19a5-4ef9-b386-c0693f2b1d90]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a59188-bab6-4d70-a0fa-fd9600e6fb38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260]
Apr 14 18:49:19 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ac59d4-2199-4345-bde8-54b22aa2dfa5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b3bbd8-c55c-4daf-baf0-46448d02fa95]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:19 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e539d11-01f4-4372-9304-fbc44d03164c]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:49:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBYpCkVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:20 user nova-compute[71308]: WARNING nova.compute.manager [req-652e0506-101e-4b42-ba90-4d325a0a104b req-d17910ce-1240-479a-8178-26f3c95a916b service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state building and task_state spawning.
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498160.4466805, 23d14a51-41aa-4827-bd60-c605d9689bc8 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:20 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] VM Resumed (Lifecycle Event)
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:49:20 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Instance spawned successfully.
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23762373732613663', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762373732613663', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:49:20 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498160.4505188, 23d14a51-41aa-4827-bd60-c605d9689bc8 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:20 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] VM Started (Lifecycle Event)
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.objects.instance [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'flavor' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:49:20 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:20 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 18:49:20 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:49:20 user nova-compute[71308]:   <serial>ced25197-205e-4821-82f2-1f37e41f5993</serial>
Apr 14 18:49:20 user nova-compute[71308]: </disk>
Apr 14 18:49:20 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:49:20 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:49:20 user nova-compute[71308]: INFO nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Took 6.28 seconds to spawn the instance on the hypervisor.
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:20 user nova-compute[71308]: INFO nova.compute.manager [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Took 19.70 seconds to build instance.
Apr 14 18:49:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c32a16b-7acc-4a04-950b-ab3195d44af4 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.800s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No VIF found with MAC fa:16:3e:11:69:69, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:49:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-38765523-a095-40f1-854e-398c3f5012f5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.368s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing instance network info cache due to event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:49:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] Acquiring lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:49:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] Acquired lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:49:22 user nova-compute[71308]: DEBUG nova.network.neutron [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:49:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:22 user nova-compute[71308]: DEBUG nova.network.neutron [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updated VIF entry in instance network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:49:22 user nova-compute[71308]: DEBUG nova.network.neutron [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updating instance_info_cache with network_info: [{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7c4b9866-c8b6-4b06-80c5-8c41d5be4ed3 req-7a6ebd0b-dff9-4f6f-883c-ec6a716929fe service nova] Releasing lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:49:23 user nova-compute[71308]: INFO nova.compute.manager [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Rebuilding instance
Apr 14 18:49:23 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'trusted_certs' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'pci_requests' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'pci_devices' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'resources' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'migration_context' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71308) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:23 user nova-compute[71308]: WARNING nova.compute.manager [req-33d72d24-e5ad-454c-8b76-a158587b6756 req-e4eea238-fcab-4b84-a0e0-a99db2e9cbde service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state active and task_state rebuilding.
Apr 14 18:49:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance destroyed successfully.
Apr 14 18:49:24 user nova-compute[71308]: INFO nova.compute.manager [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Detaching volume ced25197-205e-4821-82f2-1f37e41f5993
Apr 14 18:49:24 user nova-compute[71308]: INFO nova.virt.block_device [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attempting to driver detach volume ced25197-205e-4821-82f2-1f37e41f5993 from mountpoint /dev/vdb
Apr 14 18:49:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Attempting to detach device vdb from instance aa09363f-435d-4fa8-9f11-db0c3f4e08be from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:49:24 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:24 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 18:49:24 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:49:24 user nova-compute[71308]:   <serial>ced25197-205e-4821-82f2-1f37e41f5993</serial>
Apr 14 18:49:24 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:49:24 user nova-compute[71308]: </disk>
Apr 14 18:49:24 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:49:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully detached device vdb from instance aa09363f-435d-4fa8-9f11-db0c3f4e08be from the persistent domain config.
Apr 14 18:49:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBYpCkVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:24 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96132e1-67be-4a70-8373-665095e074eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:49:24 user nova-compute[71308]: No targets found.
Apr 14 18:49:24 user nova-compute[71308]: iSNS:
Apr 14 18:49:24 user nova-compute[71308]: No targets found.
Apr 14 18:49:24 user nova-compute[71308]: STATIC:
Apr 14 18:49:24 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993
Apr 14 18:49:24 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:24 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:24 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:49:24 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:24 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:24 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1
Apr 14 18:49:24 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:24 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:24 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:49:24 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:24 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:24 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:49:24 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:24 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:24 user nova-compute[71308]: FIRMWARE:
Apr 14 18:49:24 user nova-compute[71308]: No targets found.
Apr 14 18:49:24 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:49:24 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:49:24 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e7eb3e-4ada-45b5-8db0-0954d1ba598f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b91b5d9-5e46-4679-a444-cc59f4e0b601]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:24 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:24 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:24 user nova-compute[71308]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:24 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:24 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:24 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:24 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:24 user nova-compute[71308]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:24 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:24 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2254111360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0777f566-750c-4cf7-86f7-ff4f0e682eac]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf6d73a-e56f-45e4-b616-0f93e4d1aa15]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[151e6be8-0b00-4833-817f-26615966ffca]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb851a9-a631-4ce2-9b66-4376f89a87c8]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65962f4-f5c7-4ab8-b47a-9ad4ad5d36f5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea41cb3-6718-479a-a6c9-04156d02b212]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260]
Apr 14 18:49:24 user nova-compute[71308]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:24 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede46264-4972-4689-ae2d-8cf737cdf0d5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== disconnect_volume: return (346ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:49:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance destroyed successfully.
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:49:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_vif [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2afe22e1-00, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:49:25 user nova-compute[71308]: INFO os_vif [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00')
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBYpCkVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:25 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de701fc-bcb2-443f-a21a-99241dfaa539]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:49:25 user nova-compute[71308]: No targets found.
Apr 14 18:49:25 user nova-compute[71308]: iSNS:
Apr 14 18:49:25 user nova-compute[71308]: No targets found.
Apr 14 18:49:25 user nova-compute[71308]: STATIC:
Apr 14 18:49:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:49:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1
Apr 14 18:49:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:49:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:49:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:25 user nova-compute[71308]: FIRMWARE:
Apr 14 18:49:25 user nova-compute[71308]: No targets found.
Apr 14 18:49:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:49:25 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:49:25 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b61202-78ce-4b16-9815-0836e4b054ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f73338f-dbe3-4c49-9ebe-b340bd822967]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:25 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:25 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:25 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:25 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:25 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:25 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aaa7910>, {}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Disconnecting from: [] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== disconnect_volume: return (87ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:49:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Deleting instance files /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be_del
Apr 14 18:49:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Deletion of /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be_del complete
Apr 14 18:49:25 user nova-compute[71308]: INFO nova.virt.block_device [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Booting with volume ced25197-205e-4821-82f2-1f37e41f5993 at /dev/vdb
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:25 user nova-compute[71308]: WARNING nova.compute.manager [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state active and task_state rebuild_block_device_mapping.
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing instance network info cache due to event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Acquiring lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Acquired lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:49:25 user nova-compute[71308]: DEBUG nova.network.neutron [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG os_brick.utils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a53757-1965-447f-b959-334af5598883]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bd7853-735d-46ba-93bc-9fd21f76e116]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ea433-90a2-4ef2-b4ed-4d72677017f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef28b44-6d63-49d5-9a4d-151ccb05649c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:49:26 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2d31be-669a-4adb-bfd3-8c4e609540e8]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG os_brick.utils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating existing volume attachment record: 35dfbe5e-a5bf-4763-82ab-d7cb91748f2e {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG nova.network.neutron [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updated VIF entry in instance network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG nova.network.neutron [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updating instance_info_cache with network_info: [{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33a3f3ac-ab75-4a1f-bd42-7b1ab695bd18 req-33286b2d-58ed-4502-bf38-c05658d03118 service nova] Releasing lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:49:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:29 user nova-compute[71308]: INFO nova.compute.manager [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Rebooting instance
Apr 14 18:49:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:49:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquired lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:49:29 user nova-compute[71308]: DEBUG nova.network.neutron [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG nova.network.neutron [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updating instance_info_cache with network_info: [{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Releasing lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-unplugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] No waiting events found dispatching network-vif-unplugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:30 user nova-compute[71308]: WARNING nova.compute.manager [req-9c5ab3de-21cb-4e0e-9d2d-e8951d231407 req-589a0166-1843-49a4-8ef1-693cfce55bfe service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received unexpected event network-vif-unplugged-324b6810-d265-48bc-a2a9-ff7d4759a910 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 18:49:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "482b8c77-c963-4bc1-8e3c-847650736767" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "482b8c77-c963-4bc1-8e3c-847650736767" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:49:31 user nova-compute[71308]: INFO nova.compute.claims [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Claim successful on node user
Apr 14 18:49:31 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Instance destroyed successfully.
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.objects.instance [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'resources' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1753205108',display_name='tempest-TestMinimumBasicScenario-server-1753205108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1753205108',id=11,image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfCIaR3De/nNGfooewBKCs9Yqqif5k/8sNuCO7uN+hT9gFX4X7nnxenq2rxaGh4ksI9KaiGl0rKmMnWTxru18ybbLxqXOX8NwZxXuMtVOfaCykoVao1yh+Ul0yBt13edA==',key_name='tempest-TestMinimumBasicScenario-299923261',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e6b4e98cf9e4f96b79c3288dfe0da89',ramdisk_id='',reservation_id='r-6cmj1cxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1257841115',owner_user_name='tempest-TestMinimumBasicScenario-1257841115-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:49:30Z,user_data=None,user_id='67e1d31c2d9048699758779dedf7d3ac',uuid=656b9f90-ce93-42cd-aa1b-3ff868162aae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converting VIF {"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_vif [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap324b6810-d2, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:49:31 user nova-compute[71308]: INFO os_vif [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2')
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkIoRtub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:31 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ac11da-662f-407f-91d9-ebf6a9c9fba2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:49:31 user nova-compute[71308]: No targets found.
Apr 14 18:49:31 user nova-compute[71308]: iSNS:
Apr 14 18:49:31 user nova-compute[71308]: No targets found.
Apr 14 18:49:31 user nova-compute[71308]: STATIC:
Apr 14 18:49:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:49:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1
Apr 14 18:49:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:49:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:49:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:31 user nova-compute[71308]: FIRMWARE:
Apr 14 18:49:31 user nova-compute[71308]: No targets found.
Apr 14 18:49:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:49:31 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:49:31 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[78790c25-21b2-4cec-8f65-2345118374a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:49:31 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Creating image(s)
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f143ef-7614-41fd-8171-2d0c70aaa82b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2274153760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c276a-d615-49cc-9326-df44baa48aba]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f457e9-964b-444b-a5f2-2d17ac71f8b2]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[327f67b5-7f33-4b32-b877-6b96f7bb9a53]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7650a309-3c9d-44dc-9da8-358a9929ffaa]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.095s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c38bb44-b12a-4b1a-960a-dc8440c4e021]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.164s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk 1073741824" returned: 0 in 0.054s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b62f642-052e-43ba-8175-3acdb73dcad8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260]
Apr 14 18:49:31 user nova-compute[71308]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7808eafd-677a-4bc7-a501-5259316e2e6f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.503s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] <== disconnect_volume: return (505ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Start _get_guest_xml network_info=[{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9c46cc77-fd07-48b5-b135-2c845b3f989e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '9c46cc77-fd07-48b5-b135-2c845b3f989e'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'e5618417-c893-4a3a-8299-ddf2d9b4dcdb', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkIoRtub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '656b9f90-ce93-42cd-aa1b-3ff868162aae', 'attached_at': '', 'detached_at': '', 'volume_id': '31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 'serial': '31ad3520-e4ab-4564-8a4f-b1f9afc6d344'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:49:31 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:49:31 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=9c46cc77-fd07-48b5-b135-2c845b3f989e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.objects.instance [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'vcpu_model' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkIoRtub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:31 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:31 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:31 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.185s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[71206308-d5e8-4f03-885b-12c12f74a3bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:49:31 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a029ff78-ba4c-4a84-bb4b-39fda43b836b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344] added
Apr 14 18:49:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9196ff9-cc49-43ee-81b8-3cd6609f46d6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[892fc1b3-1cf4-4c72-b09d-a75491287ca6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkIoRtub {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.836s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Cannot resize image /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Ensure instance console log exists: /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Start _get_guest_xml network_info=[{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '35dfbe5e-a5bf-4763-82ab-d7cb91748f2e', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBYpCkVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be', 'attached_at': '', 'detached_at': '', 'volume_id': 'ced25197-205e-4821-82f2-1f37e41f5993', 'serial': 'ced25197-205e-4821-82f2-1f37e41f5993'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkIoRtub" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[479c1c9b-807a-41df-b313-a3323170eec9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qkIoRtub'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 18:49:31 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[600316ce-dddb-4411-ae0c-012ddf49b208]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBYpCkVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:31 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e5d151-9bf8-40e6-a05b-51609194e9c8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:31 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:49:31 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:49:32 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d976800-b94f-4753-b23a-e8dc2295a84d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260]
Apr 14 18:49:32 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[072efa08-aa73-4732-bc4f-301aefc455bb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e96a65b-c96c-4577-972e-ad2b14c4b6fa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:32 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:32 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:32 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:32 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:32 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:32 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:49:32 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Creating image(s)
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "/opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "/opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "/opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.policy [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f78850ecd8042dbac5f24113b9df70e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22a362d9cb946a99c203366f88baafb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec93a2c-d141-4179-b9d5-be7539226250]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkIoRtub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.164s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk 1073741824" returned: 0 in 0.054s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] No waiting events found dispatching network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:32 user nova-compute[71308]: WARNING nova.compute.manager [req-b540c086-9e60-4be2-9e83-f24801c892b0 req-dae23598-5fcb-4c7e-8eca-d241e78baa8c service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received unexpected event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Cannot resize image /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'migration_context' on Instance uuid 482b8c77-c963-4bc1-8e3c-847650736767 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Ensure instance console log exists: /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Successfully created port: 38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:49:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '23636333235383366', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636333235383366', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.227s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:33 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:33 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b098413-491a-4bc5-8055-1d0b34f232aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:49:33 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1753205108',display_name='tempest-TestMinimumBasicScenario-server-1753205108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1753205108',id=11,image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfCIaR3De/nNGfooewBKCs9Yqqif5k/8sNuCO7uN+hT9gFX4X7nnxenq2rxaGh4ksI9KaiGl0rKmMnWTxru18ybbLxqXOX8NwZxXuMtVOfaCykoVao1yh+Ul0yBt13edA==',key_name='tempest-TestMinimumBasicScenario-299923261',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e6b4e98cf9e4f96b79c3288dfe0da89',ramdisk_id='',reservation_id='r-6cmj1cxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1257841115',owner_user_name='tempest-TestMinimumBasicScenario-1257841115-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:49:30Z,user_data=None,user_id='67e1d31c2d9048699758779dedf7d3ac',uuid=656b9f90-ce93-42cd-aa1b-3ff868162aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converting VIF {"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.objects.instance [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'pci_devices' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[62996a4b-5925-4efa-9080-57e66344af94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993] added
Apr 14 18:49:33 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:49:33 user nova-compute[71308]:   <uuid>656b9f90-ce93-42cd-aa1b-3ff868162aae</uuid>
Apr 14 18:49:33 user nova-compute[71308]:   <name>instance-0000000b</name>
Apr 14 18:49:33 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:49:33 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:49:33 user nova-compute[71308]:   <metadata>
Apr 14 18:49:33 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:49:33 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:49:33 user nova-compute[71308]:       <nova:name>tempest-TestMinimumBasicScenario-server-1753205108</nova:name>
Apr 14 18:49:33 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:49:31</nova:creationTime>
Apr 14 18:49:33 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:49:33 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:49:33 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:49:33 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:49:33 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:49:33 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:49:33 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:49:33 user nova-compute[71308]:       <nova:owner>
Apr 14 18:49:33 user nova-compute[71308]:         <nova:user uuid="67e1d31c2d9048699758779dedf7d3ac">tempest-TestMinimumBasicScenario-1257841115-project-member</nova:user>
Apr 14 18:49:33 user nova-compute[71308]:         <nova:project uuid="8e6b4e98cf9e4f96b79c3288dfe0da89">tempest-TestMinimumBasicScenario-1257841115</nova:project>
Apr 14 18:49:33 user nova-compute[71308]:       </nova:owner>
Apr 14 18:49:33 user nova-compute[71308]:       <nova:root type="image" uuid="9c46cc77-fd07-48b5-b135-2c845b3f989e"/>
Apr 14 18:49:33 user nova-compute[71308]:       <nova:ports>
Apr 14 18:49:33 user nova-compute[71308]:         <nova:port uuid="324b6810-d265-48bc-a2a9-ff7d4759a910">
Apr 14 18:49:33 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 18:49:33 user nova-compute[71308]:         </nova:port>
Apr 14 18:49:33 user nova-compute[71308]:       </nova:ports>
Apr 14 18:49:33 user nova-compute[71308]:     </nova:instance>
Apr 14 18:49:33 user nova-compute[71308]:   </metadata>
Apr 14 18:49:33 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:49:33 user nova-compute[71308]:     <system>
Apr 14 18:49:33 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:49:33 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:49:33 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:49:33 user nova-compute[71308]:       <entry name="serial">656b9f90-ce93-42cd-aa1b-3ff868162aae</entry>
Apr 14 18:49:33 user nova-compute[71308]:       <entry name="uuid">656b9f90-ce93-42cd-aa1b-3ff868162aae</entry>
Apr 14 18:49:33 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:49:33 user nova-compute[71308]:     </system>
Apr 14 18:49:33 user nova-compute[71308]:   </sysinfo>
Apr 14 18:49:33 user nova-compute[71308]:   <os>
Apr 14 18:49:33 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:49:33 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:49:33 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:49:33 user nova-compute[71308]:   </os>
Apr 14 18:49:33 user nova-compute[71308]:   <features>
Apr 14 18:49:33 user nova-compute[71308]:     <acpi/>
Apr 14 18:49:33 user nova-compute[71308]:     <apic/>
Apr 14 18:49:33 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:49:33 user nova-compute[71308]:   </features>
Apr 14 18:49:33 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:49:33 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:49:33 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:49:33 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:49:33 user nova-compute[71308]:   </clock>
Apr 14 18:49:33 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:49:33 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:49:33 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:49:33 user nova-compute[71308]:   </cpu>
Apr 14 18:49:33 user nova-compute[71308]:   <devices>
Apr 14 18:49:33 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:49:33 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:49:33 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk"/>
Apr 14 18:49:33 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:49:33 user nova-compute[71308]:     </disk>
Apr 14 18:49:33 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:49:33 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:33 user nova-compute[71308]:       <source dev="/dev/sdb"/>
Apr 14 18:49:33 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:49:33 user nova-compute[71308]:       <serial>31ad3520-e4ab-4564-8a4f-b1f9afc6d344</serial>
Apr 14 18:49:33 user nova-compute[71308]:     </disk>
Apr 14 18:49:33 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:49:33 user nova-compute[71308]:       <mac address="fa:16:3e:75:42:3b"/>
Apr 14 18:49:33 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:49:33 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:49:33 user nova-compute[71308]:       <target dev="tap324b6810-d2"/>
Apr 14 18:49:33 user nova-compute[71308]:     </interface>
Apr 14 18:49:33 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:49:33 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/console.log" append="off"/>
Apr 14 18:49:33 user nova-compute[71308]:     </serial>
Apr 14 18:49:33 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:49:33 user nova-compute[71308]:     <video>
Apr 14 18:49:33 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:49:33 user nova-compute[71308]:     </video>
Apr 14 18:49:33 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:49:33 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:49:33 user nova-compute[71308]:     </rng>
Apr 14 18:49:33 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:49:33 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:49:33 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:49:33 user nova-compute[71308]:     </memballoon>
Apr 14 18:49:33 user nova-compute[71308]:   </devices>
Apr 14 18:49:33 user nova-compute[71308]: </domain>
Apr 14 18:49:33 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce43cd22-d95e-478e-9ceb-50b94b7756e9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad9b613-efcc-4ba7-a73b-0550a8b9c2d8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qBYpCkVj {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qBYpCkVj" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec0f5b-098c-4ae6-b791-fc38d6c688be]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qBYpCkVj'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[494cda15-c39f-4a20-991a-f89a56a3b8c5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[91938909-2430-4802-9323-b6a57fc43826]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:33 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:33 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ea1543-1a1e-4b93-99cb-a61d8d74c2e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260]
Apr 14 18:49:33 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:33 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d67408-dcff-4efb-8e4c-444939067c04]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[90063664-6a82-458f-8178-196b2172fec1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:33 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:33 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:33 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.objects.instance [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'trusted_certs' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8243643a-e31a-45fa-994f-54fd26422622]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBYpCkVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aca73e55d3fb41956b96766c5108df378ca6dd8e --force-share --output=json" returned: 0 in 0.157s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Cannot resize image /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.objects.instance [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'migration_context' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1753205108',display_name='tempest-TestMinimumBasicScenario-server-1753205108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1753205108',id=11,image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfCIaR3De/nNGfooewBKCs9Yqqif5k/8sNuCO7uN+hT9gFX4X7nnxenq2rxaGh4ksI9KaiGl0rKmMnWTxru18ybbLxqXOX8NwZxXuMtVOfaCykoVao1yh+Ul0yBt13edA==',key_name='tempest-TestMinimumBasicScenario-299923261',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='8e6b4e98cf9e4f96b79c3288dfe0da89',ramdisk_id='',reservation_id='r-6cmj1cxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1257841115',owner_user_name='tempest-TestMinimumBasicScenario-1257841115-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:49:30Z,user_data=None,user_id='67e1d31c2d9048699758779dedf7d3ac',uuid=656b9f90-ce93-42cd-aa1b-3ff868162aae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converting VIF {"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG os_vif [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap324b6810-d2, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap324b6810-d2, col_values=(('external_ids', {'iface-id': '324b6810-d265-48bc-a2a9-ff7d4759a910', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:42:3b', 'vm-uuid': '656b9f90-ce93-42cd-aa1b-3ff868162aae'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:49:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:33 user nova-compute[71308]: INFO os_vif [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2')
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Successfully updated port: 38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "refresh_cache-482b8c77-c963-4bc1-8e3c-847650736767" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquired lock "refresh_cache-482b8c77-c963-4bc1-8e3c-847650736767" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received event network-changed-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Refreshing instance network info cache due to event network-changed-38af2537-567f-4c06-b8f5-6e0c46f8dde6. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] Acquiring lock "refresh_cache-482b8c77-c963-4bc1-8e3c-847650736767" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Updating instance_info_cache with network_info: [{"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Releasing lock "refresh_cache-482b8c77-c963-4bc1-8e3c-847650736767" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Instance network_info: |[{"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] Acquired lock "refresh_cache-482b8c77-c963-4bc1-8e3c-847650736767" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.neutron [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Refreshing network info cache for port 38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Start _get_guest_xml network_info=[{"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:49:34 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:49:34 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-810776822',display_name='tempest-VolumesAdminNegativeTest-server-810776822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-810776822',id=15,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d22a362d9cb946a99c203366f88baafb',ramdisk_id='',reservation_id='r-wg9x4ti5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-714849235',owner_user_name='tempest-VolumesAdminNegativeTest-714849235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:49:32Z,user_data=None,user_id='3f78850ecd8042dbac5f24113b9df70e',uuid=482b8c77-c963-4bc1-8e3c-847650736767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converting VIF {"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=38af2537-567f-4c06-b8f5-6e0c46f8dde6,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38af2537-56') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'pci_devices' on Instance uuid 482b8c77-c963-4bc1-8e3c-847650736767 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== connect_volume: return (2738ms) {'type': 'block', 'scsi_wwn': '23762373732613663', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762373732613663', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:49:34 user nova-compute[71308]:   <uuid>482b8c77-c963-4bc1-8e3c-847650736767</uuid>
Apr 14 18:49:34 user nova-compute[71308]:   <name>instance-0000000f</name>
Apr 14 18:49:34 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:49:34 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:49:34 user nova-compute[71308]:   <metadata>
Apr 14 18:49:34 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:49:34 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:name>tempest-VolumesAdminNegativeTest-server-810776822</nova:name>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:49:34</nova:creationTime>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:49:34 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:49:34 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:owner>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:user uuid="3f78850ecd8042dbac5f24113b9df70e">tempest-VolumesAdminNegativeTest-714849235-project-member</nova:user>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:project uuid="d22a362d9cb946a99c203366f88baafb">tempest-VolumesAdminNegativeTest-714849235</nova:project>
Apr 14 18:49:34 user nova-compute[71308]:       </nova:owner>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:ports>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:port uuid="38af2537-567f-4c06-b8f5-6e0c46f8dde6">
Apr 14 18:49:34 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 18:49:34 user nova-compute[71308]:         </nova:port>
Apr 14 18:49:34 user nova-compute[71308]:       </nova:ports>
Apr 14 18:49:34 user nova-compute[71308]:     </nova:instance>
Apr 14 18:49:34 user nova-compute[71308]:   </metadata>
Apr 14 18:49:34 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:49:34 user nova-compute[71308]:     <system>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="serial">482b8c77-c963-4bc1-8e3c-847650736767</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="uuid">482b8c77-c963-4bc1-8e3c-847650736767</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:49:34 user nova-compute[71308]:     </system>
Apr 14 18:49:34 user nova-compute[71308]:   </sysinfo>
Apr 14 18:49:34 user nova-compute[71308]:   <os>
Apr 14 18:49:34 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:49:34 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:49:34 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:49:34 user nova-compute[71308]:   </os>
Apr 14 18:49:34 user nova-compute[71308]:   <features>
Apr 14 18:49:34 user nova-compute[71308]:     <acpi/>
Apr 14 18:49:34 user nova-compute[71308]:     <apic/>
Apr 14 18:49:34 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:49:34 user nova-compute[71308]:   </features>
Apr 14 18:49:34 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:49:34 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:49:34 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:49:34 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:49:34 user nova-compute[71308]:   </clock>
Apr 14 18:49:34 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:49:34 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:49:34 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:49:34 user nova-compute[71308]:   </cpu>
Apr 14 18:49:34 user nova-compute[71308]:   <devices>
Apr 14 18:49:34 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:49:34 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:49:34 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk"/>
Apr 14 18:49:34 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:49:34 user nova-compute[71308]:     </disk>
Apr 14 18:49:34 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:49:34 user nova-compute[71308]:       <mac address="fa:16:3e:63:8a:da"/>
Apr 14 18:49:34 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:49:34 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:49:34 user nova-compute[71308]:       <target dev="tap38af2537-56"/>
Apr 14 18:49:34 user nova-compute[71308]:     </interface>
Apr 14 18:49:34 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:49:34 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/console.log" append="off"/>
Apr 14 18:49:34 user nova-compute[71308]:     </serial>
Apr 14 18:49:34 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:49:34 user nova-compute[71308]:     <video>
Apr 14 18:49:34 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:49:34 user nova-compute[71308]:     </video>
Apr 14 18:49:34 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:49:34 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:49:34 user nova-compute[71308]:     </rng>
Apr 14 18:49:34 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:49:34 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:49:34 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:49:34 user nova-compute[71308]:     </memballoon>
Apr 14 18:49:34 user nova-compute[71308]:   </devices>
Apr 14 18:49:34 user nova-compute[71308]: </domain>
Apr 14 18:49:34 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-810776822',display_name='tempest-VolumesAdminNegativeTest-server-810776822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-810776822',id=15,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d22a362d9cb946a99c203366f88baafb',ramdisk_id='',reservation_id='r-wg9x4ti5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-714849235',owner_user_name='tempest-VolumesAdminNegativeTest-714849235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:49:32Z,user_data=None,user_id='3f78850ecd8042dbac5f24113b9df70e',uuid=482b8c77-c963-4bc1-8e3c-847650736767,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converting VIF {"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=38af2537-567f-4c06-b8f5-6e0c46f8dde6,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38af2537-56') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG os_vif [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=38af2537-567f-4c06-b8f5-6e0c46f8dde6,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38af2537-56') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38af2537-56, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38af2537-56, col_values=(('external_ids', {'iface-id': '38af2537-567f-4c06-b8f5-6e0c46f8dde6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:8a:da', 'vm-uuid': '482b8c77-c963-4bc1-8e3c-847650736767'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:49:34 user nova-compute[71308]:   <uuid>aa09363f-435d-4fa8-9f11-db0c3f4e08be</uuid>
Apr 14 18:49:34 user nova-compute[71308]:   <name>instance-00000005</name>
Apr 14 18:49:34 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:49:34 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:49:34 user nova-compute[71308]:   <metadata>
Apr 14 18:49:34 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:49:34 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:name>tempest-ServerActionsTestJSON-server-1006128169</nova:name>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:49:31</nova:creationTime>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:49:34 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:49:34 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:owner>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:user uuid="55fa4abe2fdd48cb91f39bf8156a7793">tempest-ServerActionsTestJSON-2112054326-project-member</nova:user>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:project uuid="f028a79640b848228dc6e654a0eef49b">tempest-ServerActionsTestJSON-2112054326</nova:project>
Apr 14 18:49:34 user nova-compute[71308]:       </nova:owner>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:49:34 user nova-compute[71308]:       <nova:ports>
Apr 14 18:49:34 user nova-compute[71308]:         <nova:port uuid="2afe22e1-0044-47e2-ba5f-e1d9fd6d0620">
Apr 14 18:49:34 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 18:49:34 user nova-compute[71308]:         </nova:port>
Apr 14 18:49:34 user nova-compute[71308]:       </nova:ports>
Apr 14 18:49:34 user nova-compute[71308]:     </nova:instance>
Apr 14 18:49:34 user nova-compute[71308]:   </metadata>
Apr 14 18:49:34 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:49:34 user nova-compute[71308]:     <system>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="serial">aa09363f-435d-4fa8-9f11-db0c3f4e08be</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="uuid">aa09363f-435d-4fa8-9f11-db0c3f4e08be</entry>
Apr 14 18:49:34 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:49:34 user nova-compute[71308]:     </system>
Apr 14 18:49:34 user nova-compute[71308]:   </sysinfo>
Apr 14 18:49:34 user nova-compute[71308]:   <os>
Apr 14 18:49:34 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:49:34 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:49:34 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:49:34 user nova-compute[71308]:   </os>
Apr 14 18:49:34 user nova-compute[71308]:   <features>
Apr 14 18:49:34 user nova-compute[71308]:     <acpi/>
Apr 14 18:49:34 user nova-compute[71308]:     <apic/>
Apr 14 18:49:34 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:49:34 user nova-compute[71308]:   </features>
Apr 14 18:49:34 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:49:34 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:49:34 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:49:34 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:49:34 user nova-compute[71308]:   </clock>
Apr 14 18:49:34 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:49:34 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:49:34 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:49:34 user nova-compute[71308]:   </cpu>
Apr 14 18:49:34 user nova-compute[71308]:   <devices>
Apr 14 18:49:34 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:49:34 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:49:34 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk"/>
Apr 14 18:49:34 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:49:34 user nova-compute[71308]:     </disk>
Apr 14 18:49:34 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:49:34 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:34 user nova-compute[71308]:       <source dev="/dev/sdc"/>
Apr 14 18:49:34 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:49:34 user nova-compute[71308]:       <serial>ced25197-205e-4821-82f2-1f37e41f5993</serial>
Apr 14 18:49:34 user nova-compute[71308]:     </disk>
Apr 14 18:49:34 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:49:34 user nova-compute[71308]:       <mac address="fa:16:3e:11:69:69"/>
Apr 14 18:49:34 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:49:34 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:49:34 user nova-compute[71308]:       <target dev="tap2afe22e1-00"/>
Apr 14 18:49:34 user nova-compute[71308]:     </interface>
Apr 14 18:49:34 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:49:34 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/console.log" append="off"/>
Apr 14 18:49:34 user nova-compute[71308]:     </serial>
Apr 14 18:49:34 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:49:34 user nova-compute[71308]:     <video>
Apr 14 18:49:34 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:49:34 user nova-compute[71308]:     </video>
Apr 14 18:49:34 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:49:34 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:49:34 user nova-compute[71308]:     </rng>
Apr 14 18:49:34 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:49:34 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:49:34 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:49:34 user nova-compute[71308]:     </memballoon>
Apr 14 18:49:34 user nova-compute[71308]:   </devices>
Apr 14 18:49:34 user nova-compute[71308]: </domain>
Apr 14 18:49:34 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG os_vif [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:34 user nova-compute[71308]: INFO os_vif [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=38af2537-567f-4c06-b8f5-6e0c46f8dde6,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38af2537-56')
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2afe22e1-00, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2afe22e1-00, col_values=(('external_ids', {'iface-id': '2afe22e1-0044-47e2-ba5f-e1d9fd6d0620', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:69:69', 'vm-uuid': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:34 user nova-compute[71308]: INFO os_vif [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00')
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] No VIF found with MAC fa:16:3e:63:8a:da, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:49:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No VIF found with MAC fa:16:3e:11:69:69, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:49:35 user nova-compute[71308]: DEBUG nova.network.neutron [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Updated VIF entry in instance network info cache for port 38af2537-567f-4c06-b8f5-6e0c46f8dde6. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:49:35 user nova-compute[71308]: DEBUG nova.network.neutron [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Updating instance_info_cache with network_info: [{"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3328402-957c-4dbe-a92f-35028a2abaf2 req-1d1ba2c5-522e-4ec0-93bd-36418bd9b329 service nova] Releasing lock "refresh_cache-482b8c77-c963-4bc1-8e3c-847650736767" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG nova.compute.manager [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG nova.compute.manager [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:38 user nova-compute[71308]: WARNING nova.compute.manager [req-d599976a-1e86-4139-abda-b8e7c4b173d9 req-f5d2ca25-99a4-4e41-8cde-b4592705e260 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 18:49:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:39 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498164.2227015, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:39 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Stopped (Lifecycle Event)
Apr 14 18:49:39 user nova-compute[71308]: DEBUG nova.compute.manager [None req-696fff76-4b11-4f74-99d9-76ef6b69c082 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received event network-vif-plugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] Acquiring lock "482b8c77-c963-4bc1-8e3c-847650736767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] No waiting events found dispatching network-vif-plugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:40 user nova-compute[71308]: WARNING nova.compute.manager [req-d3698823-8d9e-4bf1-8002-0741dc04f063 req-40ec35da-6743-4e15-8fee-6182276a3777 service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received unexpected event network-vif-plugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance with vm_state building and task_state spawning.
Apr 14 18:49:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:40 user nova-compute[71308]: WARNING nova.compute.manager [req-bf6e42dd-e8fb-4477-9a42-d1fa9a65bacc req-df94422c-1d31-4b80-832c-54a032e95404 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498182.0062659, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Resumed (Lifecycle Event)
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance spawned successfully.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498182.0083678, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Started (Lifecycle Event)
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received event network-vif-plugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Acquiring lock "482b8c77-c963-4bc1-8e3c-847650736767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] No waiting events found dispatching network-vif-plugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:42 user nova-compute[71308]: WARNING nova.compute.manager [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received unexpected event network-vif-plugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance with vm_state building and task_state spawning.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] No waiting events found dispatching network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:42 user nova-compute[71308]: WARNING nova.compute.manager [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received unexpected event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] No waiting events found dispatching network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:42 user nova-compute[71308]: WARNING nova.compute.manager [req-3dbb10d3-a758-45ed-84f2-bd695617ef50 req-cee037d9-dbda-4984-b20a-23158527e29e service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received unexpected event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 for instance with vm_state active and task_state reboot_started_hard.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498182.2978685, 482b8c77-c963-4bc1-8e3c-847650736767 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] VM Resumed (Lifecycle Event)
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Instance spawned successfully.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498182.3030555, 482b8c77-c963-4bc1-8e3c-847650736767 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] VM Started (Lifecycle Event)
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71308) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Instance rebooted successfully.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 656b9f90-ce93-42cd-aa1b-3ff868162aae due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498182.3852608, 656b9f90-ce93-42cd-aa1b-3ff868162aae => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] VM Resumed (Lifecycle Event)
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Took 10.33 seconds to spawn the instance on the hypervisor.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-aea44c67-9a02-4989-a76b-0c5eb242437e tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 13.270s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e53cface-e4a6-4a74-862c-b6d0c93b784f tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.158s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498182.3864741, 656b9f90-ce93-42cd-aa1b-3ff868162aae => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] VM Started (Lifecycle Event)
Apr 14 18:49:42 user nova-compute[71308]: INFO nova.compute.manager [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Took 11.55 seconds to build instance.
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c6ed7914-d936-4c91-bad8-44cbdf81aba0 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "482b8c77-c963-4bc1-8e3c-847650736767" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.657s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:43 user nova-compute[71308]: INFO nova.compute.manager [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Terminating instance
Apr 14 18:49:43 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:49:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Instance destroyed successfully.
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.objects.instance [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lazy-loading 'resources' on Instance uuid e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-444984251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-444984251',id=8,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrYUmyFto3lIJuJXMBF4CtTfKVUh4V940geNTK4f4QpKuvkvp83JV/2A/URZIxQB6Rti00M04f5rrnUAVtSObiD6MPSlbY3ycoBt9DEYh9gUdRaEpFW19N4OEj4Ecmh4Q==',key_name='tempest-keypair-1208398939',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efae74f239e14c29b3af28c7fceee94d',ramdisk_id='',reservation_id='r-qypqgwqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2056271432',owner_user_name='tempest-TaggedAttachmentsTest-2056271432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b083d961ab7546a7bb743d034c5e0815',uuid=e3e82a4d-89b7-4bd5-8b22-f17a019e6b99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converting VIF {"id": "a23ae571-1be9-4877-b629-567eb9c62b9d", "address": "fa:16:3e:07:da:92", "network": {"id": "1b859fd2-98b3-4a26-97a9-7208e978bae8", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1295624526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efae74f239e14c29b3af28c7fceee94d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa23ae571-1b", "ovs_interfaceid": "a23ae571-1be9-4877-b629-567eb9c62b9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:da:92,bridge_name='br-int',has_traffic_filtering=True,id=a23ae571-1be9-4877-b629-567eb9c62b9d,network=Network(1b859fd2-98b3-4a26-97a9-7208e978bae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23ae571-1b') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG os_vif [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:da:92,bridge_name='br-int',has_traffic_filtering=True,id=a23ae571-1be9-4877-b629-567eb9c62b9d,network=Network(1b859fd2-98b3-4a26-97a9-7208e978bae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23ae571-1b') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa23ae571-1b, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-unplugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-unplugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-unplugged-a23ae571-1be9-4877-b629-567eb9c62b9d for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:44 user nova-compute[71308]: WARNING nova.compute.manager [req-c21dfbe1-9956-4dec-8c8e-1bc1e6c4af99 req-1bd2284c-15db-4ba1-8d11-81e521ef109b service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d for instance with vm_state active and task_state deleting.
Apr 14 18:49:44 user nova-compute[71308]: INFO os_vif [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:da:92,bridge_name='br-int',has_traffic_filtering=True,id=a23ae571-1be9-4877-b629-567eb9c62b9d,network=Network(1b859fd2-98b3-4a26-97a9-7208e978bae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa23ae571-1b')
Apr 14 18:49:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Deleting instance files /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99_del
Apr 14 18:49:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Deletion of /opt/stack/data/nova/instances/e3e82a4d-89b7-4bd5-8b22-f17a019e6b99_del complete
Apr 14 18:49:44 user nova-compute[71308]: INFO nova.compute.manager [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Took 1.10 seconds to destroy the instance on the hypervisor.
Apr 14 18:49:44 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:45 user nova-compute[71308]: INFO nova.compute.manager [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Detaching volume 2b5b5249-f5b0-4713-81d6-7593e5705ae1
Apr 14 18:49:45 user nova-compute[71308]: INFO nova.virt.block_device [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Attempting to driver detach volume 2b5b5249-f5b0-4713-81d6-7593e5705ae1 from mountpoint /dev/vdb
Apr 14 18:49:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Attempting to detach device vdb from instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:49:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:49:45 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:45 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:49:45 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:49:45 user nova-compute[71308]:   <serial>2b5b5249-f5b0-4713-81d6-7593e5705ae1</serial>
Apr 14 18:49:45 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:49:45 user nova-compute[71308]: </disk>
Apr 14 18:49:45 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:49:45 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Successfully detached device vdb from instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 from the persistent domain config.
Apr 14 18:49:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:49:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:49:45 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:49:45 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:49:45 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:49:45 user nova-compute[71308]:   <serial>2b5b5249-f5b0-4713-81d6-7593e5705ae1</serial>
Apr 14 18:49:45 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:49:45 user nova-compute[71308]: </disk>
Apr 14 18:49:45 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:49:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498186.0796788, 2c4f47d7-95da-4a01-b6e6-eb14933fede7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:49:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Successfully detached device vdb from instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7 from the live domain config.
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INZtFGds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:46 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a55c9e-2a29-4ff1-90c1-de4c8345b210]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:49:46 user nova-compute[71308]: No targets found.
Apr 14 18:49:46 user nova-compute[71308]: iSNS:
Apr 14 18:49:46 user nova-compute[71308]: No targets found.
Apr 14 18:49:46 user nova-compute[71308]: STATIC:
Apr 14 18:49:46 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993
Apr 14 18:49:46 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:46 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:46 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:49:46 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:46 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:46 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1
Apr 14 18:49:46 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:46 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:46 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:49:46 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:46 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:46 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:49:46 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:46 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:46 user nova-compute[71308]: FIRMWARE:
Apr 14 18:49:46 user nova-compute[71308]: No targets found.
Apr 14 18:49:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:49:46 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:49:46 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e205e05-f94b-4f77-8d2f-1cba7f1f19e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d475a9e-740e-4892-84d1-709fe811b23f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:46 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:46 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:46 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:46 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:46 user nova-compute[71308]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 (non-flash)
Apr 14 18:49:46 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:46 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:46 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227a90d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1'): ({'sdf'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Removing single pathed devices sdf {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2230ab-5150-42fa-a969-ec28a9455650]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[996bd6cb-d02a-4e9d-8b95-02a7293bc99d]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flushing IO for device /dev/sdf {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[376569f4-42d4-4598-9760-e47681eb7293]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3a1735-cc3b-47d4-988f-031343b2435b]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6699dc-49d0-49af-8927-aec6656d33d8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:46 user nova-compute[71308]: WARNING nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d for instance with vm_state active and task_state deleting.
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:46 user nova-compute[71308]: WARNING nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d for instance with vm_state active and task_state deleting.
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-unplugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-unplugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-unplugged-a23ae571-1be9-4877-b629-567eb9c62b9d for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Acquiring lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] No waiting events found dispatching network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:46 user nova-compute[71308]: WARNING nova.compute.manager [req-849d43f7-d3ad-4fcc-828a-11e5827a15dc req-02ed068a-b25c-4f53-b805-6feccfae768e service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received unexpected event network-vif-plugged-a23ae571-1be9-4877-b629-567eb9c62b9d for instance with vm_state active and task_state deleting.
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c60444-f904-4157-9cac-4617a4d0bc86]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1, portal: 172.16.0.220,3260]
Apr 14 18:49:46 user nova-compute[71308]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1, portal: 172.16.0.220,3260] successful.
Apr 14 18:49:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab574b5c-bddc-494c-9d1b-2427159b46ab]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] <== disconnect_volume: return (386ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Received event network-vif-deleted-a23ae571-1be9-4877-b629-567eb9c62b9d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:46 user nova-compute[71308]: INFO nova.compute.manager [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Neutron deleted interface a23ae571-1be9-4877-b629-567eb9c62b9d; detaching it from the instance and deleting it from the info cache
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.network.neutron [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:46 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Took 2.21 seconds to deallocate network for instance.
Apr 14 18:49:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1a30cb8-c7c8-4fc3-a449-8eab935e4f3d req-30aa82fc-2ef4-4abc-9b1d-1475cc17da92 service nova] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Detach interface failed, port_id=a23ae571-1be9-4877-b629-567eb9c62b9d, reason: Instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:47 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Deleted allocations for instance e3e82a4d-89b7-4bd5-8b22-f17a019e6b99
Apr 14 18:49:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bfd0a517-35ad-46d0-b42f-33fe5ba4069d tempest-TaggedAttachmentsTest-2056271432 tempest-TaggedAttachmentsTest-2056271432-project-member] Lock "e3e82a4d-89b7-4bd5-8b22-f17a019e6b99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.112s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'flavor' on Instance uuid 2c4f47d7-95da-4a01-b6e6-eb14933fede7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d7ed7e41-63d6-42c2-8806-ea1b4f2bf379 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.225s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.053s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:47 user nova-compute[71308]: INFO nova.compute.manager [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Terminating instance
Apr 14 18:49:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received event network-vif-unplugged-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] No waiting events found dispatching network-vif-unplugged-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-4ea0ebff-e7f2-43fe-86fa-df0d4d6ee49b req-f2c11d2d-780b-4720-b4fe-1a000f12ba60 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received event network-vif-unplugged-58380bee-fc13-4cb4-880d-8f6ce124b16f for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:49:48 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Instance destroyed successfully.
Apr 14 18:49:48 user nova-compute[71308]: DEBUG nova.objects.instance [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'resources' on Instance uuid 2c4f47d7-95da-4a01-b6e6-eb14933fede7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1069322477',display_name='tempest-VolumesSnapshotTestJSON-instance-1069322477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1069322477',id=12,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95319509fb6a4e58998703975370877a',ramdisk_id='',reservation_id='r-bw0savjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1033700636',owner_user_name='tempest-VolumesSnapshotTestJSON-1033700636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:47:26Z,user_data=None,user_id='1f3f788e144c46e7bdf6f4fe3a5aeb79',uuid=2c4f47d7-95da-4a01-b6e6-eb14933fede7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converting VIF {"id": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "address": "fa:16:3e:32:f6:3d", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58380bee-fc", "ovs_interfaceid": "58380bee-fc13-4cb4-880d-8f6ce124b16f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:f6:3d,bridge_name='br-int',has_traffic_filtering=True,id=58380bee-fc13-4cb4-880d-8f6ce124b16f,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58380bee-fc') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG os_vif [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:f6:3d,bridge_name='br-int',has_traffic_filtering=True,id=58380bee-fc13-4cb4-880d-8f6ce124b16f,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58380bee-fc') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58380bee-fc, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:49:48 user nova-compute[71308]: INFO os_vif [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:f6:3d,bridge_name='br-int',has_traffic_filtering=True,id=58380bee-fc13-4cb4-880d-8f6ce124b16f,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58380bee-fc')
Apr 14 18:49:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INZtFGds', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:49:48 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:49:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6821f95e-a2a5-4841-ac8a-107476d001e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:49:48 user nova-compute[71308]: No targets found.
Apr 14 18:49:48 user nova-compute[71308]: iSNS:
Apr 14 18:49:48 user nova-compute[71308]: No targets found.
Apr 14 18:49:48 user nova-compute[71308]: STATIC:
Apr 14 18:49:48 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993
Apr 14 18:49:48 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:48 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:48 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:49:48 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:48 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:48 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:49:48 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:48 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:48 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:49:48 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:49:48 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:49:48 user nova-compute[71308]: FIRMWARE:
Apr 14 18:49:48 user nova-compute[71308]: No targets found.
Apr 14 18:49:48 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:49:48 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:49:48 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b5b5249-f5b0-4713-81d6-7593e5705ae1', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:49:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c473756a-cb66-4451-9908-6edee316e20a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f185d2-b7a2-45ef-a1b9-1f37519bf575]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:49 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:49 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:49 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:49 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:49:49 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:49:49 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:49:49 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:49:49 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2274150e50>, {}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Disconnecting from: [] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] <== disconnect_volume: return (83ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:49:49 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Deleting instance files /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7_del
Apr 14 18:49:49 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Deletion of /opt/stack/data/nova/instances/2c4f47d7-95da-4a01-b6e6-eb14933fede7_del complete
Apr 14 18:49:49 user nova-compute[71308]: INFO nova.compute.manager [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Took 1.47 seconds to destroy the instance on the hypervisor.
Apr 14 18:49:49 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:49:49 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:49:50 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:49:50 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Took 1.02 seconds to deallocate network for instance.
Apr 14 18:49:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-669ad0a2-1907-41ee-8c92-62098af27865 req-154a4551-21d1-44f6-b36b-b87ab3b02069 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received event network-vif-deleted-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:50 user nova-compute[71308]: WARNING nova.volume.cinder [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Attachment 70529658-be7a-43fe-a195-db449bac2344 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 70529658-be7a-43fe-a195-db449bac2344. (HTTP 404) (Request-ID: req-2fc33229-94bf-46bc-8aac-a47c0549975f)
Apr 14 18:49:50 user nova-compute[71308]: INFO nova.compute.manager [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 18:49:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:50 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:49:50 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:49:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:50 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Deleted allocations for instance 2c4f47d7-95da-4a01-b6e6-eb14933fede7
Apr 14 18:49:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received event network-vif-plugged-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:49:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] Acquiring lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] No waiting events found dispatching network-vif-plugged-58380bee-fc13-4cb4-880d-8f6ce124b16f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:49:50 user nova-compute[71308]: WARNING nova.compute.manager [req-f3bcbc52-e6ed-496b-bc1f-783f8d89dabb req-0123711c-8f77-4a59-826f-3f52a02b6617 service nova] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Received unexpected event network-vif-plugged-58380bee-fc13-4cb4-880d-8f6ce124b16f for instance with vm_state deleted and task_state None.
Apr 14 18:49:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bc967609-b1e7-4994-8388-eff9e2dd9703 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2c4f47d7-95da-4a01-b6e6-eb14933fede7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.223s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:56 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:56 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:49:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498184.2103631, e3e82a4d-89b7-4bd5-8b22-f17a019e6b99 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:49:59 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] VM Stopped (Lifecycle Event)
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-3b39e3e6-c169-450b-8d7e-f6c0a1ed87ef None None] [instance: e3e82a4d-89b7-4bd5-8b22-f17a019e6b99] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:49:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG nova.objects.instance [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'flavor' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:00 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:00 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:00 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7611MB free_disk=26.51434326171875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:00 user nova-compute[71308]: INFO nova.compute.manager [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Attaching volume e73ec3ca-6e83-4144-8fe7-315e5ee57a71 to /dev/vdb
Apr 14 18:50:01 user nova-compute[71308]: DEBUG os_brick.utils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad01827b-3314-421f-8f3e-c7c0964cf78b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29cad46-9aff-44f6-9077-d5f34d3085c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[907af5a0-26d5-419a-89de-29f66dde019d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b616b1f-d676-4eda-bf50-2baee89510c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 094a4a33-569e-4137-8798-743499f1046c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 817f112c-d806-4800-9e4a-a3892c54bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance e03adca9-8b0c-416c-943e-7dce251547c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 482b8c77-c963-4bc1-8e3c-847650736767 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:50:01 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4895e31-b2a2-40ea-a861-a0be95b605e9]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG os_brick.utils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating existing volume attachment record: 255792f8-6974-453d-9224-1736e68275f7 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:50:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:50:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:02 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:50:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating instance_info_cache with network_info: [{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498188.9050167, 2c4f47d7-95da-4a01-b6e6-eb14933fede7 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:50:03 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] VM Stopped (Lifecycle Event)
Apr 14 18:50:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-184260f3-bd33-49e7-97dc-24146a54b0df None None] [instance: 2c4f47d7-95da-4a01-b6e6-eb14933fede7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYfstCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:50:06 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:06 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:06 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a5d7cd-224f-41cd-9d5c-4ae895c68ed1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:50:06 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d401d524-146e-4b8d-9970-ae15d33c283c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71] added
Apr 14 18:50:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f668be-16b1-4f09-b575-dbd71321a535]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[72375af6-7adc-47e1-a8c1-46e290a883c3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpYfstCv {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpYfstCv" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1040e912-bb04-4cbd-a599-4d7158f3cb6c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cpYfstCv'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1206fa-537d-4fa4-9e28-79f01c6234e6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1640001-3b3c-42bb-a24f-8a042fb00438]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a28f31e-0f92-4481-b3f9-f55be75d4679]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71, portal: 172.16.0.220,3260]
Apr 14 18:50:06 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71, portal: 172.16.0.220,3260] successful.
Apr 14 18:50:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40beee3-e003-4819-8917-b951c6a2b055]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53a7188-074d-430f-8fa5-8f4289d80a92]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:06 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba9d983-d656-428b-9300-8f808d63b733]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYfstCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:06 user nova-compute[71308]: INFO nova.compute.manager [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Terminating instance
Apr 14 18:50:06 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26362643061313335', 'path': '/dev/sdf'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362643061313335', 'path': '/dev/sdf'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG nova.objects.instance [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'flavor' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:50:07 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:50:07 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:50:07 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:50:07 user nova-compute[71308]:   <serial>e73ec3ca-6e83-4144-8fe7-315e5ee57a71</serial>
Apr 14 18:50:07 user nova-compute[71308]: </disk>
Apr 14 18:50:07 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received event network-vif-unplugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] No waiting events found dispatching network-vif-unplugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-ecf26ef7-de89-4c8d-b26d-ee72f0b4fb3a req-cf9edd10-11f1-4b60-9f6b-b5de93dce8d8 service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received event network-vif-unplugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Instance destroyed successfully.
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lazy-loading 'resources' on Instance uuid e03adca9-8b0c-416c-943e-7dce251547c6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-610939182',display_name='tempest-TestVolumeSwap-server-610939182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-610939182',id=9,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOcIcfC08JbrvyMMglu/V2efEjoIrZskk6UZHHoxW7DVh/jlMeXwPkJZmJMxozdeySiwAj/pr6qdWwdHomjdRl/ESLuT0VCmFkV9cmikCZjGBOAStqcadvbYVvOOci8wQ==',key_name='tempest-keypair-722895534',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='418926b6689d48e3b7288ce32834dc93',ramdisk_id='',reservation_id='r-zw72v1ku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1301939484',owner_user_name='tempest-TestVolumeSwap-1301939484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3acb40ab30d44d5ebd26c3956b6d7e54',uuid=e03adca9-8b0c-416c-943e-7dce251547c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Converting VIF {"id": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "address": "fa:16:3e:27:37:70", "network": {"id": "85ad9a3e-94ad-4864-a75e-2ace633bd132", "bridge": "br-int", "label": "tempest-TestVolumeSwap-939374576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "418926b6689d48e3b7288ce32834dc93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd4a0af3-b3", "ovs_interfaceid": "fd4a0af3-b371-4b85-8a45-3b68d9884358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:37:70,bridge_name='br-int',has_traffic_filtering=True,id=fd4a0af3-b371-4b85-8a45-3b68d9884358,network=Network(85ad9a3e-94ad-4864-a75e-2ace633bd132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4a0af3-b3') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG os_vif [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:37:70,bridge_name='br-int',has_traffic_filtering=True,id=fd4a0af3-b371-4b85-8a45-3b68d9884358,network=Network(85ad9a3e-94ad-4864-a75e-2ace633bd132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4a0af3-b3') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd4a0af3-b3, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:08 user nova-compute[71308]: INFO os_vif [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:37:70,bridge_name='br-int',has_traffic_filtering=True,id=fd4a0af3-b371-4b85-8a45-3b68d9884358,network=Network(85ad9a3e-94ad-4864-a75e-2ace633bd132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd4a0af3-b3')
Apr 14 18:50:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Deleting instance files /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6_del
Apr 14 18:50:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Deletion of /opt/stack/data/nova/instances/e03adca9-8b0c-416c-943e-7dce251547c6_del complete
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] No VIF found with MAC fa:16:3e:24:d7:82, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:50:08 user nova-compute[71308]: INFO nova.compute.manager [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Took 1.31 seconds to destroy the instance on the hypervisor.
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:08 user nova-compute[71308]: INFO nova.compute.manager [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Terminating instance
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-41378ce1-b88e-4526-a717-c8c01ece9010 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.533s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received event network-vif-unplugged-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] Acquiring lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] No waiting events found dispatching network-vif-unplugged-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-78a09c53-5a23-4a52-9be1-d0354c8519e6 req-f420ae36-b867-4930-9fab-110948cb4b98 service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received event network-vif-unplugged-c5adcd6e-6277-40d5-8d78-4df9155319ba for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:50:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Instance destroyed successfully.
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.objects.instance [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'resources' on Instance uuid a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:48:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1130291892',display_name='tempest-AttachVolumeNegativeTest-server-1130291892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1130291892',id=13,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv5tcWUysgHNjqS8vIJY6wuxptnW7SVWtpF8Vm4ifl+8f/mUTKLgZGllDwY5TPms5tlvjb7AnrxpIcD8irOHwpoEkzOiACF26K/c654rXUweH7qfR4k/mAAGTe7KExSjg==',key_name='tempest-keypair-1533000139',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:48:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-yiisqxs4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5adcd6e-6277-40d5-8d78-4df9155319ba,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5adcd6e-62') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG os_vif [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5adcd6e-6277-40d5-8d78-4df9155319ba,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5adcd6e-62') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5adcd6e-62, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:50:09 user nova-compute[71308]: INFO os_vif [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:55:d5,bridge_name='br-int',has_traffic_filtering=True,id=c5adcd6e-6277-40d5-8d78-4df9155319ba,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5adcd6e-62')
Apr 14 18:50:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Deleting instance files /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9_del
Apr 14 18:50:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Deletion of /opt/stack/data/nova/instances/a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9_del complete
Apr 14 18:50:09 user nova-compute[71308]: INFO nova.compute.manager [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 18:50:09 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:09 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Took 0.98 seconds to deallocate network for instance.
Apr 14 18:50:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:09 user nova-compute[71308]: INFO nova.compute.manager [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Rescuing
Apr 14 18:50:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquired lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.compute.manager [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received event network-changed-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.compute.manager [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Refreshing instance network info cache due to event network-changed-c5adcd6e-6277-40d5-8d78-4df9155319ba. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Acquiring lock "refresh_cache-a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Acquired lock "refresh_cache-a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:09 user nova-compute[71308]: DEBUG nova.network.neutron [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Refreshing network info cache for port c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:09 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Deleted allocations for instance e03adca9-8b0c-416c-943e-7dce251547c6
Apr 14 18:50:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f8178740-6ab3-4cea-8c1d-9e6e46ee5c26 tempest-TestVolumeSwap-1301939484 tempest-TestVolumeSwap-1301939484-project-member] Lock "e03adca9-8b0c-416c-943e-7dce251547c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.979s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:10 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:10 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Took 1.42 seconds to deallocate network for instance.
Apr 14 18:50:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:11 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Deleted allocations for instance a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a501bb7e-ee43-485d-ad92-874b88357c2c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.883s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received event network-vif-plugged-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] Acquiring lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] Lock "a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] No waiting events found dispatching network-vif-plugged-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:11 user nova-compute[71308]: WARNING nova.compute.manager [req-999f6cd6-7225-411f-b9d2-324419c63d57 req-1031f229-d68f-4d3e-b349-ed8e630d919e service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received unexpected event network-vif-plugged-c5adcd6e-6277-40d5-8d78-4df9155319ba for instance with vm_state deleted and task_state None.
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating instance_info_cache with network_info: [{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Releasing lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.network.neutron [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Updated VIF entry in instance network info cache for port c5adcd6e-6277-40d5-8d78-4df9155319ba. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.network.neutron [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Updating instance_info_cache with network_info: [{"id": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "address": "fa:16:3e:b9:55:d5", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5adcd6e-62", "ovs_interfaceid": "c5adcd6e-6277-40d5-8d78-4df9155319ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Releasing lock "refresh_cache-a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received event network-vif-plugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Acquiring lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] Lock "e03adca9-8b0c-416c-943e-7dce251547c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] No waiting events found dispatching network-vif-plugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:11 user nova-compute[71308]: WARNING nova.compute.manager [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received unexpected event network-vif-plugged-fd4a0af3-b371-4b85-8a45-3b68d9884358 for instance with vm_state deleted and task_state None.
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-8b25baa0-5bb4-4421-ac24-997a2825e7b8 req-452c991a-de3c-4c6c-999a-08edad7e4cff service nova] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Received event network-vif-deleted-fd4a0af3-b371-4b85-8a45-3b68d9884358 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-10aadb87-0327-4cde-8b40-3ec529611bd2 req-fa781979-1acd-41b1-9792-56e3c19bfecd service nova] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Received event network-vif-deleted-c5adcd6e-6277-40d5-8d78-4df9155319ba {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-unplugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-unplugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:12 user nova-compute[71308]: WARNING nova.compute.manager [req-fd87f424-51ac-4152-87c5-7a8528dac25f req-97795772-0900-4792-b0fa-7f845f40950c service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-unplugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state active and task_state rescuing.
Apr 14 18:50:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Instance destroyed successfully.
Apr 14 18:50:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Attempting a stable device rescue
Apr 14 18:50:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71308) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Instance directory exists: not creating {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 18:50:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Creating image(s)
Apr 14 18:50:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "ba35ebad23cfcc738b3511f5a63846579549cad0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "ba35ebad23cfcc738b3511f5a63846579549cad0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0.part --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG nova.virt.images [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] 6e8245ec-8367-4bce-99df-352eae7f4ed7 was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0.part /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0.part /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0.converted" returned: 0 in 0.426s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0.converted --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "ba35ebad23cfcc738b3511f5a63846579549cad0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.480s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "ba35ebad23cfcc738b3511f5a63846579549cad0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "ba35ebad23cfcc738b3511f5a63846579549cad0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0 --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0,backing_fmt=raw /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:14 user nova-compute[71308]: WARNING nova.compute.manager [req-c20fbecf-f00f-4329-bdde-91e6d68a00d6 req-d65673f3-c2d5-4406-b80d-35d655948e27 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state active and task_state rescuing.
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba35ebad23cfcc738b3511f5a63846579549cad0,backing_fmt=raw /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue" returned: 0 in 0.052s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "ba35ebad23cfcc738b3511f5a63846579549cad0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'migration_context' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Start _get_guest_xml network_info=[{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "vif_mac": "fa:16:3e:24:d7:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6e8245ec-8367-4bce-99df-352eae7f4ed7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '255792f8-6974-453d-9224-1736e68275f7', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYfstCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '8e55c721-9fad-4478-9e74-e87d0c95bc3c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e73ec3ca-6e83-4144-8fe7-315e5ee57a71', 'serial': 'e73ec3ca-6e83-4144-8fe7-315e5ee57a71'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'resources' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:14 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:14 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYfstCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:50:14 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:14 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:14 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded3c733-9377-4ace-bff3-e112f64a5773]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cpYfstCv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 18:50:14 user nova-compute[71308]: node.name = iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71
Apr 14 18:50:14 user nova-compute[71308]: node.tpgt = -1
Apr 14 18:50:14 user nova-compute[71308]: node.startup = automatic
Apr 14 18:50:14 user nova-compute[71308]: node.leading_login = No
Apr 14 18:50:14 user nova-compute[71308]: iface.iscsi_ifacename = default
Apr 14 18:50:14 user nova-compute[71308]: iface.net_ifacename = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.ipaddress = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.prefix_len = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.hwaddress = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.transport_name = tcp
Apr 14 18:50:14 user nova-compute[71308]: iface.initiatorname = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.state = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.vlan_id = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.vlan_priority = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.vlan_state = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.iface_num = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.mtu = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.port = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.bootproto = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.subnet_mask = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.gateway = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.dhcp_alt_client_id = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.dhcp_dns = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.dhcp_learn_iqn = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.dhcp_vendor_id_state = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.dhcp_vendor_id = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.dhcp_slp_da = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.fragmentation = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.gratuitous_arp = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.incoming_forwarding = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.tos_state = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.tos = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.ttl = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.delayed_ack = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.tcp_nagle = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.tcp_wsf_state = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.tcp_wsf = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.tcp_timer_scale = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.tcp_timestamp = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.redirect = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.def_task_mgmt_timeout = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.header_digest = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.data_digest = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.immediate_data = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.initial_r2t = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.data_seq_inorder = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.data_pdu_inorder = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.erl = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.max_receive_data_len = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.first_burst_len = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.max_outstanding_r2t = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.max_burst_len = 0
Apr 14 18:50:14 user nova-compute[71308]: iface.chap_auth = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.bidi_chap = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.strict_login_compliance = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.discovery_auth = <empty>
Apr 14 18:50:14 user nova-compute[71308]: iface.discovery_logout = <empty>
Apr 14 18:50:14 user nova-compute[71308]: node.discovery_address = <empty>
Apr 14 18:50:14 user nova-compute[71308]: node.discovery_port = 0
Apr 14 18:50:14 user nova-compute[71308]: node.discovery_type = static
Apr 14 18:50:14 user nova-compute[71308]: node.session.initial_cmdsn = 0
Apr 14 18:50:14 user nova-compute[71308]: node.session.initial_login_retry_max = 8
Apr 14 18:50:14 user nova-compute[71308]: node.session.xmit_thread_priority = -20
Apr 14 18:50:14 user nova-compute[71308]: node.session.cmds_max = 128
Apr 14 18:50:14 user nova-compute[71308]: node.session.queue_depth = 32
Apr 14 18:50:14 user nova-compute[71308]: node.session.nr_sessions = 1
Apr 14 18:50:14 user nova-compute[71308]: node.session.auth.authmethod = CHAP
Apr 14 18:50:14 user nova-compute[71308]: node.session.auth.username = cpYfstCv
Apr 14 18:50:14 user nova-compute[71308]: node.session.auth.password = ***
Apr 14 18:50:14 user nova-compute[71308]: node.session.auth.username_in = <empty>
Apr 14 18:50:14 user nova-compute[71308]: node.session.auth.password_in = <empty>
Apr 14 18:50:14 user nova-compute[71308]: node.session.auth.chap_algs = MD5
Apr 14 18:50:14 user nova-compute[71308]: node.session.timeo.replacement_timeout = 120
Apr 14 18:50:14 user nova-compute[71308]: node.session.err_timeo.abort_timeout = 15
Apr 14 18:50:14 user nova-compute[71308]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 18:50:14 user nova-compute[71308]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 18:50:14 user nova-compute[71308]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.FastAbort = Yes
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.InitialR2T = No
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.ImmediateData = Yes
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.MaxConnections = 1
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 18:50:14 user nova-compute[71308]: node.session.iscsi.ERL = 0
Apr 14 18:50:14 user nova-compute[71308]: node.session.scan = manual
Apr 14 18:50:14 user nova-compute[71308]: node.session.reopen_max = 0
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].address = 172.16.0.220
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].port = 3260
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].startup = manual
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].tcp.window_size = 524288
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].tcp.type_of_service = 0
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].timeo.logout_timeout = 15
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].timeo.login_timeout = 15
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].timeo.auth_timeout = 45
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].iscsi.DataDigest = None
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].iscsi.IFMarker = No
Apr 14 18:50:14 user nova-compute[71308]: node.conn[0].iscsi.OFMarker = No
Apr 14 18:50:14 user nova-compute[71308]: # END RECORD
Apr 14 18:50:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f894af08-b406-48e4-9498-1558058bd079]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f5d3a5-71fb-40c8-88bb-a9ba423d0b47]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpYfstCv {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpYfstCv" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[423d44f9-2f92-4667-a219-c3d726065d46]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cpYfstCv'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[def1d971-bc1e-456e-bea2-d07c65330147]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[764ce305-140a-4daa-aade-431fbb45bf65]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:14 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:14 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:14 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:14 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:14 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:14 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:14 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:14 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] HCTL ('37', '0', '0', 0) found on session 19 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd0f52b-5b27-44ba-8753-65ddf8b322cc]: (4, ('0 0 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Searching for a device in session 19 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYfstCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '26362643061313335', 'path': '/dev/sdf'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362643061313335', 'path': '/dev/sdf'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1341803639',display_name='tempest-ServerStableDeviceRescueTest-server-1341803639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1341803639',id=4,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGjNz78QsEg7GY5Q/x5R0+fXhMd4+j5aNId0d7KMgDy/nQskSviXpD3wS5mHEhEb7jjb1W7n7QHncfc1ds0/3pZ7+zPW5nX4bCBjYud5GgMoBiur+7hIWtHB4iei5HABw==',key_name='tempest-keypair-1040648644',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d84c59848f445a90eb7eab6be04253',ramdisk_id='',reservation_id='r-2zoj7i2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-728638156',owner_user_name='tempest-ServerStableDeviceRescueTest-728638156-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ed7885e7774691b02c19cf08c2177f',uuid=8e55c721-9fad-4478-9e74-e87d0c95bc3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "vif_mac": "fa:16:3e:24:d7:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Converting VIF {"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "vif_mac": "fa:16:3e:24:d7:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:d7:82,bridge_name='br-int',has_traffic_filtering=True,id=66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3,network=Network(703a8d85-ee89-4c7b-addb-bc6424312027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba5ca6-da') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:50:14 user nova-compute[71308]:   <uuid>8e55c721-9fad-4478-9e74-e87d0c95bc3c</uuid>
Apr 14 18:50:14 user nova-compute[71308]:   <name>instance-00000004</name>
Apr 14 18:50:14 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:50:14 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:50:14 user nova-compute[71308]:   <metadata>
Apr 14 18:50:14 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:50:14 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:50:14 user nova-compute[71308]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1341803639</nova:name>
Apr 14 18:50:14 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:50:14</nova:creationTime>
Apr 14 18:50:14 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:50:14 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:50:14 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:50:14 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:50:14 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:50:14 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:50:14 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:50:14 user nova-compute[71308]:       <nova:owner>
Apr 14 18:50:14 user nova-compute[71308]:         <nova:user uuid="83ed7885e7774691b02c19cf08c2177f">tempest-ServerStableDeviceRescueTest-728638156-project-member</nova:user>
Apr 14 18:50:14 user nova-compute[71308]:         <nova:project uuid="64d84c59848f445a90eb7eab6be04253">tempest-ServerStableDeviceRescueTest-728638156</nova:project>
Apr 14 18:50:14 user nova-compute[71308]:       </nova:owner>
Apr 14 18:50:14 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:50:14 user nova-compute[71308]:       <nova:ports>
Apr 14 18:50:14 user nova-compute[71308]:         <nova:port uuid="66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3">
Apr 14 18:50:14 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 18:50:14 user nova-compute[71308]:         </nova:port>
Apr 14 18:50:14 user nova-compute[71308]:       </nova:ports>
Apr 14 18:50:14 user nova-compute[71308]:     </nova:instance>
Apr 14 18:50:14 user nova-compute[71308]:   </metadata>
Apr 14 18:50:14 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:50:14 user nova-compute[71308]:     <system>
Apr 14 18:50:14 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:50:14 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:50:14 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:50:14 user nova-compute[71308]:       <entry name="serial">8e55c721-9fad-4478-9e74-e87d0c95bc3c</entry>
Apr 14 18:50:14 user nova-compute[71308]:       <entry name="uuid">8e55c721-9fad-4478-9e74-e87d0c95bc3c</entry>
Apr 14 18:50:14 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:50:14 user nova-compute[71308]:     </system>
Apr 14 18:50:14 user nova-compute[71308]:   </sysinfo>
Apr 14 18:50:14 user nova-compute[71308]:   <os>
Apr 14 18:50:14 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:50:14 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:50:14 user nova-compute[71308]:   </os>
Apr 14 18:50:14 user nova-compute[71308]:   <features>
Apr 14 18:50:14 user nova-compute[71308]:     <acpi/>
Apr 14 18:50:14 user nova-compute[71308]:     <apic/>
Apr 14 18:50:14 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:50:14 user nova-compute[71308]:   </features>
Apr 14 18:50:14 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:50:14 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:50:14 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:50:14 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:50:14 user nova-compute[71308]:   </clock>
Apr 14 18:50:14 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:50:14 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:50:14 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:50:14 user nova-compute[71308]:   </cpu>
Apr 14 18:50:14 user nova-compute[71308]:   <devices>
Apr 14 18:50:14 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:50:14 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:50:14 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk"/>
Apr 14 18:50:14 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:50:14 user nova-compute[71308]:     </disk>
Apr 14 18:50:14 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:50:14 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:50:14 user nova-compute[71308]:       <source dev="/dev/sdf"/>
Apr 14 18:50:14 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:50:14 user nova-compute[71308]:       <serial>e73ec3ca-6e83-4144-8fe7-315e5ee57a71</serial>
Apr 14 18:50:14 user nova-compute[71308]:     </disk>
Apr 14 18:50:14 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:50:14 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:50:14 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue"/>
Apr 14 18:50:14 user nova-compute[71308]:       <target dev="vdc" bus="virtio"/>
Apr 14 18:50:14 user nova-compute[71308]:       <boot order="1"/>
Apr 14 18:50:14 user nova-compute[71308]:     </disk>
Apr 14 18:50:14 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:50:14 user nova-compute[71308]:       <mac address="fa:16:3e:24:d7:82"/>
Apr 14 18:50:14 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:50:14 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:50:14 user nova-compute[71308]:       <target dev="tap66ba5ca6-da"/>
Apr 14 18:50:14 user nova-compute[71308]:     </interface>
Apr 14 18:50:14 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:50:14 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/console.log" append="off"/>
Apr 14 18:50:14 user nova-compute[71308]:     </serial>
Apr 14 18:50:14 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:50:14 user nova-compute[71308]:     <video>
Apr 14 18:50:14 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:50:14 user nova-compute[71308]:     </video>
Apr 14 18:50:14 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:50:14 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:50:14 user nova-compute[71308]:     </rng>
Apr 14 18:50:14 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:50:14 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:50:14 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:50:14 user nova-compute[71308]:     </memballoon>
Apr 14 18:50:14 user nova-compute[71308]:   </devices>
Apr 14 18:50:14 user nova-compute[71308]: </domain>
Apr 14 18:50:14 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:50:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Instance destroyed successfully.
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:50:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] No VIF found with MAC fa:16:3e:24:d7:82, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:16 user nova-compute[71308]: WARNING nova.compute.manager [req-d314f2b7-610a-449e-966b-b0f76d01cf67 req-8ba894dc-41cb-4ebd-a105-a4a976698e5a service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state active and task_state rescuing.
Apr 14 18:50:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:18 user nova-compute[71308]: WARNING nova.compute.manager [req-3d298541-d1b8-441f-a195-7e41aacade33 req-4df1851b-0438-404a-8127-79e1b12681ee service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state active and task_state rescuing.
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ba3d3e3c-7d09-4f49-87eb-3870d4d397d1 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 8e55c721-9fad-4478-9e74-e87d0c95bc3c due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498218.5808115, 8e55c721-9fad-4478-9e74-e87d0c95bc3c => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:50:18 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] VM Resumed (Lifecycle Event)
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:50:18 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498218.5823712, 8e55c721-9fad-4478-9e74-e87d0c95bc3c => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:50:18 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] VM Started (Lifecycle Event)
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:50:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "1d305ab4-1813-4728-a01c-287e521a05ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:50:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:22 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:50:22 user nova-compute[71308]: INFO nova.compute.claims [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Claim successful on node user
Apr 14 18:50:22 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:50:22 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.network.neutron [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:50:23 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498208.187775, e03adca9-8b0c-416c-943e-7dce251547c6 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:50:23 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] VM Stopped (Lifecycle Event)
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-704672ba-ba64-41da-a650-13ad58b10cf5 None None] [instance: e03adca9-8b0c-416c-943e-7dce251547c6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:50:23 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Creating image(s)
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.policy [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:50:23 user nova-compute[71308]: INFO nova.compute.claims [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Claim successful on node user
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.164s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk 1073741824" returned: 0 in 0.347s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.519s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498209.113818, a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:50:24 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] VM Stopped (Lifecycle Event)
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.223s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-3cf71f26-bfa0-4508-b521-406c6df00f93 None None] [instance: a9848ddc-2342-4ca8-a77f-73b0bbd3c2a9] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.910s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Cannot resize image /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.objects.instance [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'migration_context' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Ensure instance console log exists: /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:50:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:50:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Creating image(s)
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.160s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk 1073741824" returned: 0 in 0.048s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:50:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG nova.policy [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Cannot resize image /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'migration_context' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Ensure instance console log exists: /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:25 user nova-compute[71308]: DEBUG nova.network.neutron [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Successfully created port: d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:50:26 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Successfully created port: ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Successfully updated port: d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquired lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-changed-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Refreshing instance network info cache due to event network-changed-d07ff847-3983-4b35-af36-fbd845ede770. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] Acquiring lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Successfully updated port: ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquired lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updating instance_info_cache with network_info: [{"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Releasing lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Instance network_info: |[{"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] Acquired lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.neutron [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Refreshing network info cache for port d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Start _get_guest_xml network_info=[{"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:50:27 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:27 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2104481497',display_name='tempest-ServerRescueNegativeTestJSON-server-2104481497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2104481497',id=16,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-8u3ne6pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:23Z,user_data=None,user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=1d305ab4-1813-4728-a01c-287e521a05ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=d07ff847-3983-4b35-af36-fbd845ede770,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07ff847-39') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.objects.instance [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:50:27 user nova-compute[71308]:   <uuid>1d305ab4-1813-4728-a01c-287e521a05ec</uuid>
Apr 14 18:50:27 user nova-compute[71308]:   <name>instance-00000010</name>
Apr 14 18:50:27 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:50:27 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:50:27 user nova-compute[71308]:   <metadata>
Apr 14 18:50:27 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:50:27 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:50:27 user nova-compute[71308]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2104481497</nova:name>
Apr 14 18:50:27 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:50:27</nova:creationTime>
Apr 14 18:50:27 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:50:27 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:50:27 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:50:27 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:50:27 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:50:27 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:50:27 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:50:27 user nova-compute[71308]:       <nova:owner>
Apr 14 18:50:27 user nova-compute[71308]:         <nova:user uuid="c8713ed85ffb4446847f5ded4bc2e399">tempest-ServerRescueNegativeTestJSON-1174646715-project-member</nova:user>
Apr 14 18:50:27 user nova-compute[71308]:         <nova:project uuid="e60e8abd123e414f847c68ba72894689">tempest-ServerRescueNegativeTestJSON-1174646715</nova:project>
Apr 14 18:50:27 user nova-compute[71308]:       </nova:owner>
Apr 14 18:50:27 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:50:27 user nova-compute[71308]:       <nova:ports>
Apr 14 18:50:27 user nova-compute[71308]:         <nova:port uuid="d07ff847-3983-4b35-af36-fbd845ede770">
Apr 14 18:50:27 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 18:50:27 user nova-compute[71308]:         </nova:port>
Apr 14 18:50:27 user nova-compute[71308]:       </nova:ports>
Apr 14 18:50:27 user nova-compute[71308]:     </nova:instance>
Apr 14 18:50:27 user nova-compute[71308]:   </metadata>
Apr 14 18:50:27 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:50:27 user nova-compute[71308]:     <system>
Apr 14 18:50:27 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:50:27 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:50:27 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:50:27 user nova-compute[71308]:       <entry name="serial">1d305ab4-1813-4728-a01c-287e521a05ec</entry>
Apr 14 18:50:27 user nova-compute[71308]:       <entry name="uuid">1d305ab4-1813-4728-a01c-287e521a05ec</entry>
Apr 14 18:50:27 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:50:27 user nova-compute[71308]:     </system>
Apr 14 18:50:27 user nova-compute[71308]:   </sysinfo>
Apr 14 18:50:27 user nova-compute[71308]:   <os>
Apr 14 18:50:27 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:50:27 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:50:27 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:50:27 user nova-compute[71308]:   </os>
Apr 14 18:50:27 user nova-compute[71308]:   <features>
Apr 14 18:50:27 user nova-compute[71308]:     <acpi/>
Apr 14 18:50:27 user nova-compute[71308]:     <apic/>
Apr 14 18:50:27 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:50:27 user nova-compute[71308]:   </features>
Apr 14 18:50:27 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:50:27 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:50:27 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:50:27 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:50:27 user nova-compute[71308]:   </clock>
Apr 14 18:50:27 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:50:27 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:50:27 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:50:27 user nova-compute[71308]:   </cpu>
Apr 14 18:50:27 user nova-compute[71308]:   <devices>
Apr 14 18:50:27 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:50:27 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:50:27 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk"/>
Apr 14 18:50:27 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:50:27 user nova-compute[71308]:     </disk>
Apr 14 18:50:27 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:50:27 user nova-compute[71308]:       <mac address="fa:16:3e:de:75:e0"/>
Apr 14 18:50:27 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:50:27 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:50:27 user nova-compute[71308]:       <target dev="tapd07ff847-39"/>
Apr 14 18:50:27 user nova-compute[71308]:     </interface>
Apr 14 18:50:27 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:50:27 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/console.log" append="off"/>
Apr 14 18:50:27 user nova-compute[71308]:     </serial>
Apr 14 18:50:27 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:50:27 user nova-compute[71308]:     <video>
Apr 14 18:50:27 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:50:27 user nova-compute[71308]:     </video>
Apr 14 18:50:27 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:50:27 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:50:27 user nova-compute[71308]:     </rng>
Apr 14 18:50:27 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:50:27 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:50:27 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:50:27 user nova-compute[71308]:     </memballoon>
Apr 14 18:50:27 user nova-compute[71308]:   </devices>
Apr 14 18:50:27 user nova-compute[71308]: </domain>
Apr 14 18:50:27 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2104481497',display_name='tempest-ServerRescueNegativeTestJSON-server-2104481497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2104481497',id=16,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-8u3ne6pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:23Z,user_data=None,user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=1d305ab4-1813-4728-a01c-287e521a05ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=d07ff847-3983-4b35-af36-fbd845ede770,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07ff847-39') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG os_vif [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=d07ff847-3983-4b35-af36-fbd845ede770,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07ff847-39') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd07ff847-39, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd07ff847-39, col_values=(('external_ids', {'iface-id': 'd07ff847-3983-4b35-af36-fbd845ede770', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:75:e0', 'vm-uuid': '1d305ab4-1813-4728-a01c-287e521a05ec'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:27 user nova-compute[71308]: INFO os_vif [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=d07ff847-3983-4b35-af36-fbd845ede770,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07ff847-39')
Apr 14 18:50:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No VIF found with MAC fa:16:3e:de:75:e0, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Updating instance_info_cache with network_info: [{"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Releasing lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Instance network_info: |[{"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Start _get_guest_xml network_info=[{"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:50:28 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:28 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-502749594',display_name='tempest-ServerRescueNegativeTestJSON-server-502749594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-502749594',id=17,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-ien3h5pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:24Z,user_data=None,user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=cf640f3e-3d77-46ee-8a11-e0bdc870ff97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=ee0e2f74-c744-41ec-b3f8-c7d124c61f8e,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e2f74-c7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'pci_devices' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:50:28 user nova-compute[71308]:   <uuid>cf640f3e-3d77-46ee-8a11-e0bdc870ff97</uuid>
Apr 14 18:50:28 user nova-compute[71308]:   <name>instance-00000011</name>
Apr 14 18:50:28 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:50:28 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:50:28 user nova-compute[71308]:   <metadata>
Apr 14 18:50:28 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:50:28 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:50:28 user nova-compute[71308]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-502749594</nova:name>
Apr 14 18:50:28 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:50:28</nova:creationTime>
Apr 14 18:50:28 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:50:28 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:50:28 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:50:28 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:50:28 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:50:28 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:50:28 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:50:28 user nova-compute[71308]:       <nova:owner>
Apr 14 18:50:28 user nova-compute[71308]:         <nova:user uuid="c8713ed85ffb4446847f5ded4bc2e399">tempest-ServerRescueNegativeTestJSON-1174646715-project-member</nova:user>
Apr 14 18:50:28 user nova-compute[71308]:         <nova:project uuid="e60e8abd123e414f847c68ba72894689">tempest-ServerRescueNegativeTestJSON-1174646715</nova:project>
Apr 14 18:50:28 user nova-compute[71308]:       </nova:owner>
Apr 14 18:50:28 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:50:28 user nova-compute[71308]:       <nova:ports>
Apr 14 18:50:28 user nova-compute[71308]:         <nova:port uuid="ee0e2f74-c744-41ec-b3f8-c7d124c61f8e">
Apr 14 18:50:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 18:50:28 user nova-compute[71308]:         </nova:port>
Apr 14 18:50:28 user nova-compute[71308]:       </nova:ports>
Apr 14 18:50:28 user nova-compute[71308]:     </nova:instance>
Apr 14 18:50:28 user nova-compute[71308]:   </metadata>
Apr 14 18:50:28 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:50:28 user nova-compute[71308]:     <system>
Apr 14 18:50:28 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:50:28 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:50:28 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:50:28 user nova-compute[71308]:       <entry name="serial">cf640f3e-3d77-46ee-8a11-e0bdc870ff97</entry>
Apr 14 18:50:28 user nova-compute[71308]:       <entry name="uuid">cf640f3e-3d77-46ee-8a11-e0bdc870ff97</entry>
Apr 14 18:50:28 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:50:28 user nova-compute[71308]:     </system>
Apr 14 18:50:28 user nova-compute[71308]:   </sysinfo>
Apr 14 18:50:28 user nova-compute[71308]:   <os>
Apr 14 18:50:28 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:50:28 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:50:28 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:50:28 user nova-compute[71308]:   </os>
Apr 14 18:50:28 user nova-compute[71308]:   <features>
Apr 14 18:50:28 user nova-compute[71308]:     <acpi/>
Apr 14 18:50:28 user nova-compute[71308]:     <apic/>
Apr 14 18:50:28 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:50:28 user nova-compute[71308]:   </features>
Apr 14 18:50:28 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:50:28 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:50:28 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:50:28 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:50:28 user nova-compute[71308]:   </clock>
Apr 14 18:50:28 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:50:28 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:50:28 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:50:28 user nova-compute[71308]:   </cpu>
Apr 14 18:50:28 user nova-compute[71308]:   <devices>
Apr 14 18:50:28 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:50:28 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:50:28 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk"/>
Apr 14 18:50:28 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:50:28 user nova-compute[71308]:     </disk>
Apr 14 18:50:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:50:28 user nova-compute[71308]:       <mac address="fa:16:3e:2c:ac:1c"/>
Apr 14 18:50:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:50:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:50:28 user nova-compute[71308]:       <target dev="tapee0e2f74-c7"/>
Apr 14 18:50:28 user nova-compute[71308]:     </interface>
Apr 14 18:50:28 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:50:28 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/console.log" append="off"/>
Apr 14 18:50:28 user nova-compute[71308]:     </serial>
Apr 14 18:50:28 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:50:28 user nova-compute[71308]:     <video>
Apr 14 18:50:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:50:28 user nova-compute[71308]:     </video>
Apr 14 18:50:28 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:50:28 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:50:28 user nova-compute[71308]:     </rng>
Apr 14 18:50:28 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:50:28 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:50:28 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:50:28 user nova-compute[71308]:     </memballoon>
Apr 14 18:50:28 user nova-compute[71308]:   </devices>
Apr 14 18:50:28 user nova-compute[71308]: </domain>
Apr 14 18:50:28 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-502749594',display_name='tempest-ServerRescueNegativeTestJSON-server-502749594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-502749594',id=17,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-ien3h5pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:24Z,user_data=None,user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=cf640f3e-3d77-46ee-8a11-e0bdc870ff97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=ee0e2f74-c744-41ec-b3f8-c7d124c61f8e,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e2f74-c7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG os_vif [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=ee0e2f74-c744-41ec-b3f8-c7d124c61f8e,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e2f74-c7') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee0e2f74-c7, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee0e2f74-c7, col_values=(('external_ids', {'iface-id': 'ee0e2f74-c744-41ec-b3f8-c7d124c61f8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:ac:1c', 'vm-uuid': 'cf640f3e-3d77-46ee-8a11-e0bdc870ff97'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updated VIF entry in instance network info cache for port d07ff847-3983-4b35-af36-fbd845ede770. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updating instance_info_cache with network_info: [{"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:28 user nova-compute[71308]: INFO os_vif [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=ee0e2f74-c744-41ec-b3f8-c7d124c61f8e,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e2f74-c7')
Apr 14 18:50:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-48dbab0b-aecc-4696-978a-079928bb392f req-5f01749e-1bfd-4eee-86a2-e13eaf7dd656 service nova] Releasing lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:50:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No VIF found with MAC fa:16:3e:2c:ac:1c, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-changed-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Refreshing instance network info cache due to event network-changed-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] Acquiring lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] Acquired lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Refreshing network info cache for port ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Updated VIF entry in instance network info cache for port ee0e2f74-c744-41ec-b3f8-c7d124c61f8e. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Updating instance_info_cache with network_info: [{"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-808ffd86-84b2-4312-bfb3-3a04e5c32349 req-d9d979e5-dda1-42ba-9bf9-3e811ab655f8 service nova] Releasing lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:29 user nova-compute[71308]: WARNING nova.compute.manager [req-991cc3a4-dc15-4156-9f3d-b8b479dbb7d4 req-6125defd-422a-45a5-845b-3b400fb5d6ac service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state building and task_state spawning.
Apr 14 18:50:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:32 user nova-compute[71308]: WARNING nova.compute.manager [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state building and task_state spawning.
Apr 14 18:50:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] No waiting events found dispatching network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:32 user nova-compute[71308]: WARNING nova.compute.manager [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received unexpected event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance with vm_state building and task_state spawning.
Apr 14 18:50:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] No waiting events found dispatching network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:32 user nova-compute[71308]: WARNING nova.compute.manager [req-e3694f08-d5ac-43c6-900a-919a6a123089 req-35771361-0183-412a-89b3-b7ed641b9a10 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received unexpected event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance with vm_state building and task_state spawning.
Apr 14 18:50:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498233.0768301, 1d305ab4-1813-4728-a01c-287e521a05ec => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] VM Resumed (Lifecycle Event)
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Instance spawned successfully.
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498233.07733, 1d305ab4-1813-4728-a01c-287e521a05ec => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] VM Started (Lifecycle Event)
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Took 9.99 seconds to spawn the instance on the hypervisor.
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Took 10.77 seconds to build instance.
Apr 14 18:50:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15d0b1c1-a77c-47cc-a2f6-e749a823090a tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "1d305ab4-1813-4728-a01c-287e521a05ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.887s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498233.5579758, cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] VM Resumed (Lifecycle Event)
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Instance spawned successfully.
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498233.5641463, cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] VM Started (Lifecycle Event)
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Took 9.24 seconds to spawn the instance on the hypervisor.
Apr 14 18:50:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:50:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:33 user nova-compute[71308]: INFO nova.compute.manager [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Took 10.49 seconds to build instance.
Apr 14 18:50:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8da60c0c-0446-489f-a1d0-e81350f48ece tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.618s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:50:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:35 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:50:35 user nova-compute[71308]: INFO nova.compute.claims [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Claim successful on node user
Apr 14 18:50:36 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:50:36 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:50:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:50:36 user nova-compute[71308]: INFO nova.virt.block_device [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Booting with volume 68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd at /dev/vda
Apr 14 18:50:36 user nova-compute[71308]: DEBUG os_brick.utils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[896090cb-22aa-4b05-a983-d8d7ca4560fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[091df86e-db23-49fa-b6af-6bab86da960a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0391d78-d4db-4687-81d7-d6aa903768ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0e1265-3a6c-4d19-9278-74c934141c9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:50:36 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:50:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[172cf260-b3eb-40c4-8c7d-0655c8ae04d7]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG os_brick.utils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating existing volume attachment record: ab55e61d-177a-4ea8-a03b-fe9568bd40ff {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:50:36 user nova-compute[71308]: DEBUG nova.policy [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ee19795311144e69dd00db0403cb8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c49bffa4d8e4f92a54ad17a5f5db634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:50:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:39 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully created port: 7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:50:39 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully created port: 6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:50:40 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully created port: 6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:50:41 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully created port: 3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully created port: bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:50:42 user nova-compute[71308]: INFO nova.virt.block_device [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Booting with volume ba800019-a4b5-415c-8525-6059d9336490 at /dev/vdb
Apr 14 18:50:42 user nova-compute[71308]: DEBUG os_brick.utils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f53cb48-c827-4aa1-93f8-034e721b31a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbb32b4-21b0-4603-9afc-d35f1061276a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3704c485-22fa-421b-bcd1-42ab3c42edb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b576b1e9-645c-4fc2-815f-7527017519d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:50:42 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:50:42 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a20a35-6e0d-4008-9b57-3f55c155bf58]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG os_brick.utils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:50:42 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating existing volume attachment record: 1078df06-854e-48bc-8b30-9d1ca28e907a {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully updated port: 7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-changed-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing instance network info cache due to event network-changed-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] Acquiring lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] Acquired lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG nova.network.neutron [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing network info cache for port 7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG nova.network.neutron [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG nova.network.neutron [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-907b298f-d656-46ac-8faa-64b9b8449bd3 req-df5fe897-3c9a-4777-aee4-124ce0f5803f service nova] Releasing lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:44 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully updated port: 2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully updated port: f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-changed-2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing instance network info cache due to event network-changed-2af029d9-055b-406b-a82d-a88d8b51c4fa. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Acquiring lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Acquired lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG nova.network.neutron [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing network info cache for port 2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG nova.network.neutron [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG nova.network.neutron [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Releasing lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-changed-f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing instance network info cache due to event network-changed-f4fbff28-9aec-444f-aef4-a67e882a9255. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Acquiring lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Acquired lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:45 user nova-compute[71308]: DEBUG nova.network.neutron [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing network info cache for port f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:46 user nova-compute[71308]: DEBUG nova.network.neutron [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:50:47 user nova-compute[71308]: DEBUG nova.network.neutron [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a42be3fb-e419-41c2-8c6e-a3f1d9953b2c req-2568c153-626d-4332-8365-f83d6415c150 service nova] Releasing lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:47 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully updated port: 6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-changed-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing instance network info cache due to event network-changed-6dc22897-5349-4914-8ab8-eafee74a17dc. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] Acquiring lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] Acquired lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:47 user nova-compute[71308]: DEBUG nova.network.neutron [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing network info cache for port 6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:47 user nova-compute[71308]: DEBUG nova.network.neutron [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG nova.network.neutron [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-42aaa425-0f5e-4186-93fb-f8a6a33f5880 req-09b63ad1-a107-4bbc-a21c-483f6e7d478a service nova] Releasing lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:48 user nova-compute[71308]: INFO nova.virt.block_device [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Booting with volume a1039149-f70d-4abd-a8fa-48767f099f90 at /dev/vdc
Apr 14 18:50:48 user nova-compute[71308]: DEBUG os_brick.utils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b796a9e5-44fd-4bab-891e-7c3b77b1d42b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a54326-97d7-4e1d-9cbd-24d635ec3762]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d57c98-9fc9-4db2-854d-842635ed8636]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e981d1da-61a7-46e7-8c4d-7f2c69b305a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully updated port: 6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:50:48 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:50:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdbff9e-a1b8-4594-821e-eaa90f5b5369]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG os_brick.utils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:50:48 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating existing volume attachment record: f323700b-f681-496b-9bd5-1e87cbedb709 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:50:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully updated port: 3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-changed-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing instance network info cache due to event network-changed-6b1efba7-12bf-4333-a320-c76218ba1b09. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] Acquiring lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] Acquired lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:49 user nova-compute[71308]: DEBUG nova.network.neutron [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing network info cache for port 6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:49 user nova-compute[71308]: DEBUG nova.network.neutron [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:50:50 user nova-compute[71308]: DEBUG nova.network.neutron [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-58b2138c-c001-4965-8d17-e31d1c00089e req-db8e3566-1af3-4826-b134-f4ed4f27cca6 service nova] Releasing lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Successfully updated port: bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquired lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:50:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-changed-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing instance network info cache due to event network-changed-3ad5bb9e-1641-4726-887d-031aeadf4c60. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Acquiring lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:50:52 user nova-compute[71308]: INFO nova.compute.manager [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Rescuing
Apr 14 18:50:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquired lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:52 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updating instance_info_cache with network_info: [{"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Releasing lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:50:53 user nova-compute[71308]: INFO nova.compute.claims [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Claim successful on node user
Apr 14 18:50:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-unplugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-unplugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:54 user nova-compute[71308]: WARNING nova.compute.manager [req-d4a72d7e-6271-4e3c-bc64-b6dcf1fdc5e7 req-345f456c-7956-4511-9cdb-21212990171a service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-unplugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state active and task_state rescuing.
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:50:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Creating image(s)
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Ensure instance console log exists: /opt/stack/data/nova/instances/dc260db7-ffd6-4b7a-8b70-b4070478faab/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:50:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Instance destroyed successfully.
Apr 14 18:50:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Attempting a stable device rescue
Apr 14 18:50:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71308) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Instance directory exists: not creating {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 18:50:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Creating image(s)
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "/opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "/opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "/opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'trusted_certs' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "651dda1b18ef19e8bed67b4e5fcca79d13d0ead1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "651dda1b18ef19e8bed67b4e5fcca79d13d0ead1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:50:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Creating image(s)
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "/opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "/opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "/opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:55 user nova-compute[71308]: DEBUG nova.policy [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f3f788e144c46e7bdf6f4fe3a5aeb79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95319509fb6a4e58998703975370877a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:50:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 1.175s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1.part --force-share --output=json" returned: 0 in 0.179s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.images [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 56a2ce04-e0cd-4616-b0e4-c76c59fd278e was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1.part /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.158s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk 1073741824" returned: 0 in 0.182s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.compute.manager [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.compute.manager [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:56 user nova-compute[71308]: WARNING nova.compute.manager [req-d92759e6-44e9-474b-851a-877c9d627d4e req-5ff1d49e-8774-4b47-93d1-cf495ee053b4 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state active and task_state rescuing.
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1.part /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1.converted" returned: 0 in 0.347s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.184s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "651dda1b18ef19e8bed67b4e5fcca79d13d0ead1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.841s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "651dda1b18ef19e8bed67b4e5fcca79d13d0ead1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "651dda1b18ef19e8bed67b4e5fcca79d13d0ead1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Cannot resize image /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.objects.instance [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'migration_context' on Instance uuid 1285eca2-575b-4550-a424-605fb186b510 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Ensure instance console log exists: /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1 --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1,backing_fmt=raw /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/651dda1b18ef19e8bed67b4e5fcca79d13d0ead1,backing_fmt=raw /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue" returned: 0 in 0.064s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "651dda1b18ef19e8bed67b4e5fcca79d13d0ead1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'migration_context' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Start _get_guest_xml network_info=[{"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "vif_mac": "fa:16:3e:90:27:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '56a2ce04-e0cd-4616-b0e4-c76c59fd278e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'a3e459f5-bcdc-4d94-a036-61785cc2372e', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qosgFUfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '23d14a51-41aa-4827-bd60-c605d9689bc8', 'attached_at': '', 'detached_at': '', 'volume_id': '45b3dec9-bffa-4042-b85b-b8f6620c5955', 'serial': '45b3dec9-bffa-4042-b85b-b8f6620c5955'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'resources' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'numa_topology' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:56 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:56 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'vcpu_model' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qosgFUfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:50:56 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:56 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:56 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f835a8-d896-4838-8659-5a077de82486]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qosgFUfc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 18:50:57 user nova-compute[71308]: node.name = iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:50:57 user nova-compute[71308]: node.tpgt = -1
Apr 14 18:50:57 user nova-compute[71308]: node.startup = automatic
Apr 14 18:50:57 user nova-compute[71308]: node.leading_login = No
Apr 14 18:50:57 user nova-compute[71308]: iface.iscsi_ifacename = default
Apr 14 18:50:57 user nova-compute[71308]: iface.net_ifacename = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.ipaddress = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.prefix_len = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.hwaddress = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.transport_name = tcp
Apr 14 18:50:57 user nova-compute[71308]: iface.initiatorname = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.state = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.vlan_id = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.vlan_priority = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.vlan_state = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.iface_num = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.mtu = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.port = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.bootproto = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.subnet_mask = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.gateway = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.dhcp_alt_client_id = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.dhcp_dns = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.dhcp_learn_iqn = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.dhcp_vendor_id_state = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.dhcp_vendor_id = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.dhcp_slp_da = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.fragmentation = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.gratuitous_arp = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.incoming_forwarding = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.tos_state = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.tos = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.ttl = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.delayed_ack = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.tcp_nagle = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.tcp_wsf_state = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.tcp_wsf = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.tcp_timer_scale = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.tcp_timestamp = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.redirect = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.def_task_mgmt_timeout = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.header_digest = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.data_digest = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.immediate_data = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.initial_r2t = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.data_seq_inorder = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.data_pdu_inorder = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.erl = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.max_receive_data_len = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.first_burst_len = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.max_outstanding_r2t = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.max_burst_len = 0
Apr 14 18:50:57 user nova-compute[71308]: iface.chap_auth = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.bidi_chap = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.strict_login_compliance = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.discovery_auth = <empty>
Apr 14 18:50:57 user nova-compute[71308]: iface.discovery_logout = <empty>
Apr 14 18:50:57 user nova-compute[71308]: node.discovery_address = <empty>
Apr 14 18:50:57 user nova-compute[71308]: node.discovery_port = 0
Apr 14 18:50:57 user nova-compute[71308]: node.discovery_type = static
Apr 14 18:50:57 user nova-compute[71308]: node.session.initial_cmdsn = 0
Apr 14 18:50:57 user nova-compute[71308]: node.session.initial_login_retry_max = 8
Apr 14 18:50:57 user nova-compute[71308]: node.session.xmit_thread_priority = -20
Apr 14 18:50:57 user nova-compute[71308]: node.session.cmds_max = 128
Apr 14 18:50:57 user nova-compute[71308]: node.session.queue_depth = 32
Apr 14 18:50:57 user nova-compute[71308]: node.session.nr_sessions = 1
Apr 14 18:50:57 user nova-compute[71308]: node.session.auth.authmethod = CHAP
Apr 14 18:50:57 user nova-compute[71308]: node.session.auth.username = qosgFUfc
Apr 14 18:50:57 user nova-compute[71308]: node.session.auth.password = ***
Apr 14 18:50:57 user nova-compute[71308]: node.session.auth.username_in = <empty>
Apr 14 18:50:57 user nova-compute[71308]: node.session.auth.password_in = <empty>
Apr 14 18:50:57 user nova-compute[71308]: node.session.auth.chap_algs = MD5
Apr 14 18:50:57 user nova-compute[71308]: node.session.timeo.replacement_timeout = 120
Apr 14 18:50:57 user nova-compute[71308]: node.session.err_timeo.abort_timeout = 15
Apr 14 18:50:57 user nova-compute[71308]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 18:50:57 user nova-compute[71308]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 18:50:57 user nova-compute[71308]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.FastAbort = Yes
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.InitialR2T = No
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.ImmediateData = Yes
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.MaxConnections = 1
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 18:50:57 user nova-compute[71308]: node.session.iscsi.ERL = 0
Apr 14 18:50:57 user nova-compute[71308]: node.session.scan = manual
Apr 14 18:50:57 user nova-compute[71308]: node.session.reopen_max = 0
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].address = 172.16.0.220
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].port = 3260
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].startup = manual
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].tcp.window_size = 524288
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].tcp.type_of_service = 0
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].timeo.logout_timeout = 15
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].timeo.login_timeout = 15
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].timeo.auth_timeout = 45
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].iscsi.DataDigest = None
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].iscsi.IFMarker = No
Apr 14 18:50:57 user nova-compute[71308]: node.conn[0].iscsi.OFMarker = No
Apr 14 18:50:57 user nova-compute[71308]: # END RECORD
Apr 14 18:50:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82db648-becd-4874-a088-e1c1599a5476]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[62712536-05f1-47c5-ba00-9d62cd457701]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qosgFUfc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qosgFUfc" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[440ecc73-9455-4c53-8687-dcfbd6900a1d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qosgFUfc'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c37f8-3448-409b-8dab-352be427aa0f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a644cb11-82f2-4753-81e2-f8d49cb116ff]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] HCTL ('35', '0', '0', 0) found on session 14 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[068c6804-31fa-49d6-ac80-649f26960917]: (4, ('0 0 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Searching for a device in session 14 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qosgFUfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.204s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] <== connect_volume: return (205ms) {'type': 'block', 'scsi_wwn': '26364333331306538', 'path': '/dev/sdd'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364333331306538', 'path': '/dev/sdd'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219397521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219397521',id=14,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:49:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-8vhrdkcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:49:21Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=23d14a51-41aa-4827-bd60-c605d9689bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "vif_mac": "fa:16:3e:90:27:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "vif_mac": "fa:16:3e:90:27:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:27:c8,bridge_name='br-int',has_traffic_filtering=True,id=b8044678-899b-4461-bbf0-cf9fd662e71e,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8044678-89') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'pci_devices' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:50:57 user nova-compute[71308]:   <uuid>23d14a51-41aa-4827-bd60-c605d9689bc8</uuid>
Apr 14 18:50:57 user nova-compute[71308]:   <name>instance-0000000e</name>
Apr 14 18:50:57 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:50:57 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:50:57 user nova-compute[71308]:   <metadata>
Apr 14 18:50:57 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:50:57 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:50:57 user nova-compute[71308]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1219397521</nova:name>
Apr 14 18:50:57 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:50:56</nova:creationTime>
Apr 14 18:50:57 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:50:57 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:50:57 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:50:57 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:50:57 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:50:57 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:50:57 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:50:57 user nova-compute[71308]:       <nova:owner>
Apr 14 18:50:57 user nova-compute[71308]:         <nova:user uuid="a644b8bb9b90494ba670da8315bfe005">tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member</nova:user>
Apr 14 18:50:57 user nova-compute[71308]:         <nova:project uuid="424e732759884efa8fd126cd9a082c8a">tempest-ServerBootFromVolumeStableRescueTest-1815450365</nova:project>
Apr 14 18:50:57 user nova-compute[71308]:       </nova:owner>
Apr 14 18:50:57 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:50:57 user nova-compute[71308]:       <nova:ports>
Apr 14 18:50:57 user nova-compute[71308]:         <nova:port uuid="b8044678-899b-4461-bbf0-cf9fd662e71e">
Apr 14 18:50:57 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 18:50:57 user nova-compute[71308]:         </nova:port>
Apr 14 18:50:57 user nova-compute[71308]:       </nova:ports>
Apr 14 18:50:57 user nova-compute[71308]:     </nova:instance>
Apr 14 18:50:57 user nova-compute[71308]:   </metadata>
Apr 14 18:50:57 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:50:57 user nova-compute[71308]:     <system>
Apr 14 18:50:57 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:50:57 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:50:57 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:50:57 user nova-compute[71308]:       <entry name="serial">23d14a51-41aa-4827-bd60-c605d9689bc8</entry>
Apr 14 18:50:57 user nova-compute[71308]:       <entry name="uuid">23d14a51-41aa-4827-bd60-c605d9689bc8</entry>
Apr 14 18:50:57 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:50:57 user nova-compute[71308]:     </system>
Apr 14 18:50:57 user nova-compute[71308]:   </sysinfo>
Apr 14 18:50:57 user nova-compute[71308]:   <os>
Apr 14 18:50:57 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:50:57 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:50:57 user nova-compute[71308]:   </os>
Apr 14 18:50:57 user nova-compute[71308]:   <features>
Apr 14 18:50:57 user nova-compute[71308]:     <acpi/>
Apr 14 18:50:57 user nova-compute[71308]:     <apic/>
Apr 14 18:50:57 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:50:57 user nova-compute[71308]:   </features>
Apr 14 18:50:57 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:50:57 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:50:57 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:50:57 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:50:57 user nova-compute[71308]:   </clock>
Apr 14 18:50:57 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:50:57 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:50:57 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:50:57 user nova-compute[71308]:   </cpu>
Apr 14 18:50:57 user nova-compute[71308]:   <devices>
Apr 14 18:50:57 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:50:57 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:50:57 user nova-compute[71308]:       <source dev="/dev/sdd"/>
Apr 14 18:50:57 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:50:57 user nova-compute[71308]:       <serial>45b3dec9-bffa-4042-b85b-b8f6620c5955</serial>
Apr 14 18:50:57 user nova-compute[71308]:     </disk>
Apr 14 18:50:57 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:50:57 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:50:57 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue"/>
Apr 14 18:50:57 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:50:57 user nova-compute[71308]:       <boot order="1"/>
Apr 14 18:50:57 user nova-compute[71308]:     </disk>
Apr 14 18:50:57 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:50:57 user nova-compute[71308]:       <mac address="fa:16:3e:90:27:c8"/>
Apr 14 18:50:57 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:50:57 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:50:57 user nova-compute[71308]:       <target dev="tapb8044678-89"/>
Apr 14 18:50:57 user nova-compute[71308]:     </interface>
Apr 14 18:50:57 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:50:57 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/console.log" append="off"/>
Apr 14 18:50:57 user nova-compute[71308]:     </serial>
Apr 14 18:50:57 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:50:57 user nova-compute[71308]:     <video>
Apr 14 18:50:57 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:50:57 user nova-compute[71308]:     </video>
Apr 14 18:50:57 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:50:57 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:50:57 user nova-compute[71308]:     </rng>
Apr 14 18:50:57 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:50:57 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:50:57 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:50:57 user nova-compute[71308]:     </memballoon>
Apr 14 18:50:57 user nova-compute[71308]:   </devices>
Apr 14 18:50:57 user nova-compute[71308]: </domain>
Apr 14 18:50:57 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:50:57 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Instance destroyed successfully.
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No VIF found with MAC fa:16:3e:90:27:c8, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Successfully created port: 0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [{"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Releasing lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance network_info: |[{"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Acquired lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.network.neutron [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing network info cache for port 3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Start _get_guest_xml network_info=[{"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'ab55e61d-177a-4ea8-a03b-fe9568bd40ff', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjLWOhiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc260db7-ffd6-4b7a-8b70-b4070478faab', 'attached_at': '', 'detached_at': '', 'volume_id': '68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd', 'serial': '68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': '1078df06-854e-48bc-8b30-9d1ca28e907a', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfjTemYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc260db7-ffd6-4b7a-8b70-b4070478faab', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba800019-a4b5-415c-8525-6059d9336490', 'serial': 'ba800019-a4b5-415c-8525-6059d9336490'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'delete_on_termination': False, 'attachment_id': 'f323700b-f681-496b-9bd5-1e87cbedb709', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKfXeQZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc260db7-ffd6-4b7a-8b70-b4070478faab', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1039149-f70d-4abd-a8fa-48767f099f90', 'serial': 'a1039149-f70d-4abd-a8fa-48767f099f90'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:50:57 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:57 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjLWOhiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:50:57 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:57 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:57 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[203f29fe-6fbf-44fb-a4bb-1e3d9582a60f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:50:57 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[86abcfbd-42fe-409a-851b-0cec4415fb23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd] added
Apr 14 18:50:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc515e1e-3e2b-4c22-8769-80e668bc8416]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e97d1de-1fc7-4b34-9b98-3b4edd1413c7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjLWOhiQ {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjLWOhiQ" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aacede3-e841-4148-b621-6dbef16c93ce]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zjLWOhiQ'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d440a6e4-8b70-497e-8077-bc99ba3f818f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc73a9f-5bf7-484b-bbe4-266a281601fe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:57 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:50:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b16131f-b5ad-4d04-9859-c2605303d8b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd, portal: 172.16.0.220,3260]
Apr 14 18:50:58 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd, portal: 172.16.0.220,3260] successful.
Apr 14 18:50:58 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7ec7fb-c6dc-46e4-9b23-78a078783efe]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[de91e2be-1b51-47a0-ab59-dc798ce983ef]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:58 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:50:58 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:58 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d07ae1-15b9-497f-9ead-451b707351c3]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjLWOhiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:58 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:50:59 user nova-compute[71308]: WARNING nova.compute.manager [req-ce8c4c97-c665-49cc-b3da-fb3ae45095af req-8416f0b9-1765-4013-b1b7-d7221b6684dc service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state active and task_state rescuing.
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.network.neutron [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updated VIF entry in instance network info cache for port 3ad5bb9e-1641-4726-887d-031aeadf4c60. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.network.neutron [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [{"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Releasing lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-changed-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing instance network info cache due to event network-changed-bb067fd8-e349-48fe-8450-b2308b4ccdab. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Acquiring lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Acquired lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.network.neutron [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing network info cache for port bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '26131383761393462', 'path': '/dev/sdg'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131383761393462', 'path': '/dev/sdg'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfjTemYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:50:59 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:59 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:50:59 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef61f2e-930b-4387-a23a-197ab0719602]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:50:59 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d8602b-0c72-4697-ba90-b541dc95b824]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490] added
Apr 14 18:50:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4250c8-c288-4807-a179-1efc3da550de]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc581af1-149c-4808-b6b9-16de2077e202]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfjTemYO {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WfjTemYO" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc1d0fe-4d92-44a0-93f8-fe93533f6ff8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WfjTemYO'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e5a82-a79b-44c7-9456-9244c9d0d3d6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Successfully updated port: 0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74dd231-adfb-4798-bf3c-1c44aa8095d9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "refresh_cache-1285eca2-575b-4550-a424-605fb186b510" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquired lock "refresh_cache-1285eca2-575b-4550-a424-605fb186b510" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received event network-changed-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Refreshing instance network info cache due to event network-changed-0ccfdc96-01f1-414d-8693-963f116cfd62. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] Acquiring lock "refresh_cache-1285eca2-575b-4550-a424-605fb186b510" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaa440a-e39d-4ca5-8e58-0b1a90bbbb8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490, portal: 172.16.0.220,3260]
Apr 14 18:50:59 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490, portal: 172.16.0.220,3260] successful.
Apr 14 18:50:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d20e3bf-21c2-42c0-9767-17a16b1be056]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f2bb68-8568-4548-afc6-c0b13e24e99f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:50:59 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:50:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.481s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5721c49e-8dbe-4232-9066-ee239127c53b]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfjTemYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:50:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.network.neutron [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updated VIF entry in instance network info cache for port bb067fd8-e349-48fe-8450-b2308b4ccdab. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.network.neutron [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [{"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-07465a4f-2951-4342-9897-f85db6c4da7b req-273c6676-cc02-46d7-8c48-39fdc38d0942 service nova] Releasing lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.network.neutron [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Updating instance_info_cache with network_info: [{"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue --force-share --output=json" returned: 0 in 0.296s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Releasing lock "refresh_cache-1285eca2-575b-4550-a424-605fb186b510" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Instance network_info: |[{"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] Acquired lock "refresh_cache-1285eca2-575b-4550-a424-605fb186b510" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.network.neutron [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Refreshing network info cache for port 0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Start _get_guest_xml network_info=[{"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:51:00 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:51:00 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1940672222',display_name='tempest-VolumesSnapshotTestJSON-instance-1940672222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1940672222',id=19,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95319509fb6a4e58998703975370877a',ramdisk_id='',reservation_id='r-37lb68zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1033700636',owner_user_name='tempest-VolumesSnapshotTestJSON-1033700636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:55Z,user_data=None,user_id='1f3f788e144c46e7bdf6f4fe3a5aeb79',uuid=1285eca2-575b-4550-a424-605fb186b510,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converting VIF {"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=0ccfdc96-01f1-414d-8693-963f116cfd62,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ccfdc96-01') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.objects.instance [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'pci_devices' on Instance uuid 1285eca2-575b-4550-a424-605fb186b510 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:51:00 user nova-compute[71308]:   <uuid>1285eca2-575b-4550-a424-605fb186b510</uuid>
Apr 14 18:51:00 user nova-compute[71308]:   <name>instance-00000013</name>
Apr 14 18:51:00 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:51:00 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:51:00 user nova-compute[71308]:   <metadata>
Apr 14 18:51:00 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:51:00 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:51:00 user nova-compute[71308]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1940672222</nova:name>
Apr 14 18:51:00 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:51:00</nova:creationTime>
Apr 14 18:51:00 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:51:00 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:51:00 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:51:00 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:51:00 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:51:00 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:51:00 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:51:00 user nova-compute[71308]:       <nova:owner>
Apr 14 18:51:00 user nova-compute[71308]:         <nova:user uuid="1f3f788e144c46e7bdf6f4fe3a5aeb79">tempest-VolumesSnapshotTestJSON-1033700636-project-member</nova:user>
Apr 14 18:51:00 user nova-compute[71308]:         <nova:project uuid="95319509fb6a4e58998703975370877a">tempest-VolumesSnapshotTestJSON-1033700636</nova:project>
Apr 14 18:51:00 user nova-compute[71308]:       </nova:owner>
Apr 14 18:51:00 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:51:00 user nova-compute[71308]:       <nova:ports>
Apr 14 18:51:00 user nova-compute[71308]:         <nova:port uuid="0ccfdc96-01f1-414d-8693-963f116cfd62">
Apr 14 18:51:00 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 18:51:00 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:00 user nova-compute[71308]:       </nova:ports>
Apr 14 18:51:00 user nova-compute[71308]:     </nova:instance>
Apr 14 18:51:00 user nova-compute[71308]:   </metadata>
Apr 14 18:51:00 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:51:00 user nova-compute[71308]:     <system>
Apr 14 18:51:00 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:51:00 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:51:00 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:51:00 user nova-compute[71308]:       <entry name="serial">1285eca2-575b-4550-a424-605fb186b510</entry>
Apr 14 18:51:00 user nova-compute[71308]:       <entry name="uuid">1285eca2-575b-4550-a424-605fb186b510</entry>
Apr 14 18:51:00 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:51:00 user nova-compute[71308]:     </system>
Apr 14 18:51:00 user nova-compute[71308]:   </sysinfo>
Apr 14 18:51:00 user nova-compute[71308]:   <os>
Apr 14 18:51:00 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:51:00 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:51:00 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:51:00 user nova-compute[71308]:   </os>
Apr 14 18:51:00 user nova-compute[71308]:   <features>
Apr 14 18:51:00 user nova-compute[71308]:     <acpi/>
Apr 14 18:51:00 user nova-compute[71308]:     <apic/>
Apr 14 18:51:00 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:51:00 user nova-compute[71308]:   </features>
Apr 14 18:51:00 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:51:00 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:51:00 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:51:00 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:51:00 user nova-compute[71308]:   </clock>
Apr 14 18:51:00 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:51:00 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:51:00 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:51:00 user nova-compute[71308]:   </cpu>
Apr 14 18:51:00 user nova-compute[71308]:   <devices>
Apr 14 18:51:00 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:51:00 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:51:00 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk"/>
Apr 14 18:51:00 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:51:00 user nova-compute[71308]:     </disk>
Apr 14 18:51:00 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:00 user nova-compute[71308]:       <mac address="fa:16:3e:86:ec:d9"/>
Apr 14 18:51:00 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:00 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:00 user nova-compute[71308]:       <target dev="tap0ccfdc96-01"/>
Apr 14 18:51:00 user nova-compute[71308]:     </interface>
Apr 14 18:51:00 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:51:00 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/console.log" append="off"/>
Apr 14 18:51:00 user nova-compute[71308]:     </serial>
Apr 14 18:51:00 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:51:00 user nova-compute[71308]:     <video>
Apr 14 18:51:00 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:00 user nova-compute[71308]:     </video>
Apr 14 18:51:00 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:51:00 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:51:00 user nova-compute[71308]:     </rng>
Apr 14 18:51:00 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:51:00 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:51:00 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:51:00 user nova-compute[71308]:     </memballoon>
Apr 14 18:51:00 user nova-compute[71308]:   </devices>
Apr 14 18:51:00 user nova-compute[71308]: </domain>
Apr 14 18:51:00 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1940672222',display_name='tempest-VolumesSnapshotTestJSON-instance-1940672222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1940672222',id=19,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95319509fb6a4e58998703975370877a',ramdisk_id='',reservation_id='r-37lb68zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1033700636',owner_user_name='tempest-VolumesSnapshotTestJSON-1033700636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:55Z,user_data=None,user_id='1f3f788e144c46e7bdf6f4fe3a5aeb79',uuid=1285eca2-575b-4550-a424-605fb186b510,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converting VIF {"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=0ccfdc96-01f1-414d-8693-963f116cfd62,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ccfdc96-01') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_vif [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=0ccfdc96-01f1-414d-8693-963f116cfd62,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ccfdc96-01') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ccfdc96-01, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ccfdc96-01, col_values=(('external_ids', {'iface-id': '0ccfdc96-01f1-414d-8693-963f116cfd62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:ec:d9', 'vm-uuid': '1285eca2-575b-4550-a424-605fb186b510'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:00 user nova-compute[71308]: INFO os_vif [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=0ccfdc96-01f1-414d-8693-963f116cfd62,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ccfdc96-01')
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No VIF found with MAC fa:16:3e:86:ec:d9, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] <== connect_volume: return (1539ms) {'type': 'block', 'scsi_wwn': '23362643061373161', 'path': '/dev/sdh'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362643061373161', 'path': '/dev/sdh'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:51:00 user nova-compute[71308]: INFO nova.compute.manager [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Detaching volume 8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:00 user nova-compute[71308]: INFO nova.virt.block_device [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Attempting to driver detach volume 8000d5a4-c39b-41b5-a47c-0f83b55fa0ab from mountpoint /dev/vdb
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKfXeQZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:51:00 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:51:00 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:51:00 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e19a7b2-31ee-48ba-8853-db91a36216d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:51:00 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Attempting to detach device vdb from instance 094a4a33-569e-4137-8798-743499f1046c from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:51:00 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:51:00 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:51:00 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:51:00 user nova-compute[71308]:   <serial>8000d5a4-c39b-41b5-a47c-0f83b55fa0ab</serial>
Apr 14 18:51:00 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:51:00 user nova-compute[71308]: </disk>
Apr 14 18:51:00 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f63c906-ced2-4baf-a4cb-9d8085dce38f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90] added
Apr 14 18:51:00 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:00 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully detached device vdb from instance 094a4a33-569e-4137-8798-743499f1046c from the persistent domain config.
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 094a4a33-569e-4137-8798-743499f1046c from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:51:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:51:00 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:51:00 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:51:00 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:51:00 user nova-compute[71308]:   <serial>8000d5a4-c39b-41b5-a47c-0f83b55fa0ab</serial>
Apr 14 18:51:00 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:51:00 user nova-compute[71308]: </disk>
Apr 14 18:51:00 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7403b8-d71e-41fa-9a45-0e8a04bf506e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[773599de-44ec-437c-97c7-581a3f9de955]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.network.neutron [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Updated VIF entry in instance network info cache for port 0ccfdc96-01f1-414d-8693-963f116cfd62. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.network.neutron [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Updating instance_info_cache with network_info: [{"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKfXeQZn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-64304156-c69c-49d4-82c1-477c7a1970fa req-ede45723-3f57-4516-8ca9-48a55b1e7db4 service nova] Releasing lock "refresh_cache-1285eca2-575b-4550-a424-605fb186b510" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bKfXeQZn" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b8989e-f38e-4cf5-872f-d23af1efd4d7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bKfXeQZn'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c42c4d-3062-412e-86a0-ceb6210dd1bd]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:01 user nova-compute[71308]: WARNING nova.compute.manager [req-829091f3-2aa2-4c73-a14b-a64bf669cb2f req-cd187d72-74e7-449a-bc1f-19f761dc7336 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state active and task_state rescuing.
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f293d90-d5b6-41bb-875d-d122866ef7e7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:51:01 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:51:01 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a407cf88-9fc4-4cb0-a4df-c71f13c2b69c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90, portal: 172.16.0.220,3260]
Apr 14 18:51:01 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90, portal: 172.16.0.220,3260] successful.
Apr 14 18:51:01 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[adea5fc3-a4be-4afc-87fd-2230a4efe970]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8c4c6d-ea2a-4040-acf4-a79eb9d27245]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:51:01 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:01 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:51:01 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] HCTL ('40', '-', '-', 0) found on session 22 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdceb5c-38af-4056-b45f-ef1f7a89b5b8]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 23d14a51-41aa-4827-bd60-c605d9689bc8 due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498261.3872893, 23d14a51-41aa-4827-bd60-c605d9689bc8 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:01 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] VM Resumed (Lifecycle Event)
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Searching for a device in session 22 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKfXeQZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7054a2a0-a219-4022-9b81-38a05388f60a tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:01 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498261.3892357, 23d14a51-41aa-4827-bd60-c605d9689bc8 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:01 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] VM Started (Lifecycle Event)
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498261.649913, 094a4a33-569e-4137-8798-743499f1046c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 094a4a33-569e-4137-8798-743499f1046c {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:51:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully detached device vdb from instance 094a4a33-569e-4137-8798-743499f1046c from the live domain config.
Apr 14 18:51:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdYiDytN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:51:01 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:51:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] <== connect_volume: return (1527ms) {'type': 'block', 'scsi_wwn': '26433326338316634', 'path': '/dev/sdi'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433326338316634', 'path': '/dev/sdi'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.765s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.109s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[654a9b0a-8d1e-4751-bde4-5c3030e96917]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:51:02 user nova-compute[71308]: No targets found.
Apr 14 18:51:02 user nova-compute[71308]: iSNS:
Apr 14 18:51:02 user nova-compute[71308]: No targets found.
Apr 14 18:51:02 user nova-compute[71308]: STATIC:
Apr 14 18:51:02 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71
Apr 14 18:51:02 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:02 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:02 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd
Apr 14 18:51:02 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:02 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:02 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993
Apr 14 18:51:02 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:02 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:02 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:51:02 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:02 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:02 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab
Apr 14 18:51:02 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:02 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:02 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90
Apr 14 18:51:02 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:02 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:02 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490
Apr 14 18:51:02 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:02 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:02 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:51:02 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:02 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:02 user nova-compute[71308]: FIRMWARE:
Apr 14 18:51:02 user nova-compute[71308]: No targets found.
Apr 14 18:51:02 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:51:02 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:51:02 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b03c8b9-ba05-4473-963d-e49a7d5e6534]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8,network=Network(6508b35e-2e3c-4d6a-8952-0176e7be3891),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5b6c2-fb') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:77:3c,bridge_name='br-int',has_traffic_filtering=True,id=2af029d9-055b-406b-a82d-a88d8b51c4fa,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2af029d9-05') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4fbff28-9aec-444f-aef4-a67e882a9255,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4fbff28-9a') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=6dc22897-5349-4914-8ab8-eafee74a17dc,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc22897-53') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b4:b3,bridge_name='br-int',has_traffic_filtering=True,id=6b1efba7-12bf-4333-a320-c76218ba1b09,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1efba7-12') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:9f:83,bridge_name='br-int',has_traffic_filtering=True,id=3ad5bb9e-1641-4726-887d-031aeadf4c60,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad5bb9e-16') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=bb067fd8-e349-48fe-8450-b2308b4ccdab,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb067fd8-e3') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lazy-loading 'pci_devices' on Instance uuid dc260db7-ffd6-4b7a-8b70-b4070478faab {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[373a6ed6-1c27-45bc-a54c-34b3c9ad1f9e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:51:02 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:02 user nova-compute[71308]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab (non-flash)
Apr 14 18:51:02 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f226c226cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab'): ({'sde'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Removing single pathed devices sde {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:51:02 user nova-compute[71308]:   <uuid>dc260db7-ffd6-4b7a-8b70-b4070478faab</uuid>
Apr 14 18:51:02 user nova-compute[71308]:   <name>instance-00000012</name>
Apr 14 18:51:02 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:51:02 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:51:02 user nova-compute[71308]:   <metadata>
Apr 14 18:51:02 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:51:02 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:51:02 user nova-compute[71308]:       <nova:name>tempest-device-tagging-server-750671987</nova:name>
Apr 14 18:51:02 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:50:57</nova:creationTime>
Apr 14 18:51:02 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:51:02 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:51:02 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:51:02 user nova-compute[71308]:       <nova:owner>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:user uuid="9ee19795311144e69dd00db0403cb8b1">tempest-TaggedBootDevicesTest_v242-632155347-project-member</nova:user>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:project uuid="5c49bffa4d8e4f92a54ad17a5f5db634">tempest-TaggedBootDevicesTest_v242-632155347</nova:project>
Apr 14 18:51:02 user nova-compute[71308]:       </nova:owner>
Apr 14 18:51:02 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:51:02 user nova-compute[71308]:       <nova:ports>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:port uuid="7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8">
Apr 14 18:51:02 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 18:51:02 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:port uuid="2af029d9-055b-406b-a82d-a88d8b51c4fa">
Apr 14 18:51:02 user nova-compute[71308]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Apr 14 18:51:02 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:port uuid="f4fbff28-9aec-444f-aef4-a67e882a9255">
Apr 14 18:51:02 user nova-compute[71308]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
Apr 14 18:51:02 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:port uuid="6dc22897-5349-4914-8ab8-eafee74a17dc">
Apr 14 18:51:02 user nova-compute[71308]:           <nova:ip type="fixed" address="10.1.1.180" ipVersion="4"/>
Apr 14 18:51:02 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:port uuid="6b1efba7-12bf-4333-a320-c76218ba1b09">
Apr 14 18:51:02 user nova-compute[71308]:           <nova:ip type="fixed" address="10.1.1.150" ipVersion="4"/>
Apr 14 18:51:02 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:port uuid="3ad5bb9e-1641-4726-887d-031aeadf4c60">
Apr 14 18:51:02 user nova-compute[71308]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 18:51:02 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:02 user nova-compute[71308]:         <nova:port uuid="bb067fd8-e349-48fe-8450-b2308b4ccdab">
Apr 14 18:51:02 user nova-compute[71308]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 18:51:02 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:02 user nova-compute[71308]:       </nova:ports>
Apr 14 18:51:02 user nova-compute[71308]:     </nova:instance>
Apr 14 18:51:02 user nova-compute[71308]:   </metadata>
Apr 14 18:51:02 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:51:02 user nova-compute[71308]:     <system>
Apr 14 18:51:02 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:51:02 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:51:02 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:51:02 user nova-compute[71308]:       <entry name="serial">dc260db7-ffd6-4b7a-8b70-b4070478faab</entry>
Apr 14 18:51:02 user nova-compute[71308]:       <entry name="uuid">dc260db7-ffd6-4b7a-8b70-b4070478faab</entry>
Apr 14 18:51:02 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:51:02 user nova-compute[71308]:     </system>
Apr 14 18:51:02 user nova-compute[71308]:   </sysinfo>
Apr 14 18:51:02 user nova-compute[71308]:   <os>
Apr 14 18:51:02 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:51:02 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:51:02 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:51:02 user nova-compute[71308]:   </os>
Apr 14 18:51:02 user nova-compute[71308]:   <features>
Apr 14 18:51:02 user nova-compute[71308]:     <acpi/>
Apr 14 18:51:02 user nova-compute[71308]:     <apic/>
Apr 14 18:51:02 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:51:02 user nova-compute[71308]:   </features>
Apr 14 18:51:02 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:51:02 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:51:02 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:51:02 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:51:02 user nova-compute[71308]:   </clock>
Apr 14 18:51:02 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:51:02 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:51:02 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:51:02 user nova-compute[71308]:   </cpu>
Apr 14 18:51:02 user nova-compute[71308]:   <devices>
Apr 14 18:51:02 user nova-compute[71308]:     <disk type="file" device="cdrom">
Apr 14 18:51:02 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 18:51:02 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/dc260db7-ffd6-4b7a-8b70-b4070478faab/disk.config"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="hda" bus="ide"/>
Apr 14 18:51:02 user nova-compute[71308]:     </disk>
Apr 14 18:51:02 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:51:02 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:51:02 user nova-compute[71308]:       <source dev="/dev/sdg"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <serial>68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd</serial>
Apr 14 18:51:02 user nova-compute[71308]:     </disk>
Apr 14 18:51:02 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:51:02 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:51:02 user nova-compute[71308]:       <source dev="/dev/sdh"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <serial>ba800019-a4b5-415c-8525-6059d9336490</serial>
Apr 14 18:51:02 user nova-compute[71308]:     </disk>
Apr 14 18:51:02 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:51:02 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:51:02 user nova-compute[71308]:       <source dev="/dev/sdi"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="vdc" bus="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <serial>a1039149-f70d-4abd-a8fa-48767f099f90</serial>
Apr 14 18:51:02 user nova-compute[71308]:     </disk>
Apr 14 18:51:02 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:02 user nova-compute[71308]:       <mac address="fa:16:3e:9b:9a:f6"/>
Apr 14 18:51:02 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="tap7ff5b6c2-fb"/>
Apr 14 18:51:02 user nova-compute[71308]:     </interface>
Apr 14 18:51:02 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:02 user nova-compute[71308]:       <mac address="fa:16:3e:c2:77:3c"/>
Apr 14 18:51:02 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="tap2af029d9-05"/>
Apr 14 18:51:02 user nova-compute[71308]:     </interface>
Apr 14 18:51:02 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:02 user nova-compute[71308]:       <mac address="fa:16:3e:cf:5d:d6"/>
Apr 14 18:51:02 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="tapf4fbff28-9a"/>
Apr 14 18:51:02 user nova-compute[71308]:     </interface>
Apr 14 18:51:02 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:02 user nova-compute[71308]:       <mac address="fa:16:3e:30:56:8a"/>
Apr 14 18:51:02 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="tap6dc22897-53"/>
Apr 14 18:51:02 user nova-compute[71308]:     </interface>
Apr 14 18:51:02 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:02 user nova-compute[71308]:       <mac address="fa:16:3e:40:b4:b3"/>
Apr 14 18:51:02 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="tap6b1efba7-12"/>
Apr 14 18:51:02 user nova-compute[71308]:     </interface>
Apr 14 18:51:02 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:02 user nova-compute[71308]:       <mac address="fa:16:3e:6d:9f:83"/>
Apr 14 18:51:02 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="tap3ad5bb9e-16"/>
Apr 14 18:51:02 user nova-compute[71308]:     </interface>
Apr 14 18:51:02 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:02 user nova-compute[71308]:       <mac address="fa:16:3e:5c:b6:4b"/>
Apr 14 18:51:02 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:02 user nova-compute[71308]:       <target dev="tapbb067fd8-e3"/>
Apr 14 18:51:02 user nova-compute[71308]:     </interface>
Apr 14 18:51:02 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:51:02 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/dc260db7-ffd6-4b7a-8b70-b4070478faab/console.log" append="off"/>
Apr 14 18:51:02 user nova-compute[71308]:     </serial>
Apr 14 18:51:02 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:51:02 user nova-compute[71308]:     <video>
Apr 14 18:51:02 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:02 user nova-compute[71308]:     </video>
Apr 14 18:51:02 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:51:02 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:51:02 user nova-compute[71308]:     </rng>
Apr 14 18:51:02 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:51:02 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:51:02 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:51:02 user nova-compute[71308]:     </memballoon>
Apr 14 18:51:02 user nova-compute[71308]:   </devices>
Apr 14 18:51:02 user nova-compute[71308]: </domain>
Apr 14 18:51:02 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8,network=Network(6508b35e-2e3c-4d6a-8952-0176e7be3891),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5b6c2-fb') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8,network=Network(6508b35e-2e3c-4d6a-8952-0176e7be3891),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5b6c2-fb') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ff5b6c2-fb, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ff5b6c2-fb, col_values=(('external_ids', {'iface-id': '7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:9a:f6', 'vm-uuid': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb405c3-af93-4fca-8f44-0aba00150aca]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: INFO os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8,network=Network(6508b35e-2e3c-4d6a-8952-0176e7be3891),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5b6c2-fb')
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:77:3c,bridge_name='br-int',has_traffic_filtering=True,id=2af029d9-055b-406b-a82d-a88d8b51c4fa,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2af029d9-05') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:77:3c,bridge_name='br-int',has_traffic_filtering=True,id=2af029d9-055b-406b-a82d-a88d8b51c4fa,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2af029d9-05') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2af029d9-05, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2af029d9-05, col_values=(('external_ids', {'iface-id': '2af029d9-055b-406b-a82d-a88d8b51c4fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:77:3c', 'vm-uuid': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea75241-7c64-4aaa-9c10-427ebb1fbc54]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flushing IO for device /dev/sde {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67cefb5-8fb4-49d4-af05-e2a65c1ea6c7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:02 user nova-compute[71308]: INFO os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:77:3c,bridge_name='br-int',has_traffic_filtering=True,id=2af029d9-055b-406b-a82d-a88d8b51c4fa,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2af029d9-05')
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4fbff28-9aec-444f-aef4-a67e882a9255,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4fbff28-9a') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4fbff28-9aec-444f-aef4-a67e882a9255,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4fbff28-9a') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received event network-vif-plugged-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] Lock "1285eca2-575b-4550-a424-605fb186b510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] Lock "1285eca2-575b-4550-a424-605fb186b510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] No waiting events found dispatching network-vif-plugged-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:02 user nova-compute[71308]: WARNING nova.compute.manager [req-e787eef1-97c6-47c0-a5ac-27afc2b9fa1a req-0914a46c-c8da-4790-a437-85bda8ab1c30 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received unexpected event network-vif-plugged-0ccfdc96-01f1-414d-8693-963f116cfd62 for instance with vm_state building and task_state spawning.
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4fbff28-9a, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4fbff28-9a, col_values=(('external_ids', {'iface-id': 'f4fbff28-9aec-444f-aef4-a67e882a9255', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:5d:d6', 'vm-uuid': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27864df-cd79-40f0-9992-2e1b5e6e67b1]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: INFO os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4fbff28-9aec-444f-aef4-a67e882a9255,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4fbff28-9a')
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=6dc22897-5349-4914-8ab8-eafee74a17dc,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc22897-53') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=6dc22897-5349-4914-8ab8-eafee74a17dc,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc22897-53') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6dc22897-53, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6dc22897-53, col_values=(('external_ids', {'iface-id': '6dc22897-5349-4914-8ab8-eafee74a17dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:56:8a', 'vm-uuid': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[63400b04-8117-49f7-87f3-bd17d1733dfd]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: INFO os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=6dc22897-5349-4914-8ab8-eafee74a17dc,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc22897-53')
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b4:b3,bridge_name='br-int',has_traffic_filtering=True,id=6b1efba7-12bf-4333-a320-c76218ba1b09,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1efba7-12') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b4:b3,bridge_name='br-int',has_traffic_filtering=True,id=6b1efba7-12bf-4333-a320-c76218ba1b09,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1efba7-12') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[76267c12-a961-4ae9-a424-3acaea9877ad]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab, portal: 172.16.0.220,3260]
Apr 14 18:51:03 user nova-compute[71308]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab, portal: 172.16.0.220,3260] successful.
Apr 14 18:51:03 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b1efba7-12, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b1efba7-12, col_values=(('external_ids', {'iface-id': '6b1efba7-12bf-4333-a320-c76218ba1b09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:b4:b3', 'vm-uuid': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8000d5a4-c39b-41b5-a47c-0f83b55fa0ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0295e52-c852-402c-ba1f-02ee70c595b7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.622s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] <== disconnect_volume: return (1386ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: INFO os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b4:b3,bridge_name='br-int',has_traffic_filtering=True,id=6b1efba7-12bf-4333-a320-c76218ba1b09,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1efba7-12')
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:9f:83,bridge_name='br-int',has_traffic_filtering=True,id=3ad5bb9e-1641-4726-887d-031aeadf4c60,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad5bb9e-16') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:9f:83,bridge_name='br-int',has_traffic_filtering=True,id=3ad5bb9e-1641-4726-887d-031aeadf4c60,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad5bb9e-16') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ad5bb9e-16, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ad5bb9e-16, col_values=(('external_ids', {'iface-id': '3ad5bb9e-1641-4726-887d-031aeadf4c60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:9f:83', 'vm-uuid': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: INFO os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:9f:83,bridge_name='br-int',has_traffic_filtering=True,id=3ad5bb9e-1641-4726-887d-031aeadf4c60,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad5bb9e-16')
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=bb067fd8-e349-48fe-8450-b2308b4ccdab,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb067fd8-e3') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=bb067fd8-e349-48fe-8450-b2308b4ccdab,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb067fd8-e3') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb067fd8-e3, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb067fd8-e3, col_values=(('external_ids', {'iface-id': 'bb067fd8-e349-48fe-8450-b2308b4ccdab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:b6:4b', 'vm-uuid': 'dc260db7-ffd6-4b7a-8b70-b4070478faab'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:03 user nova-compute[71308]: INFO os_vif [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=bb067fd8-e349-48fe-8450-b2308b4ccdab,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb067fd8-e3')
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] No BDM found with device name hda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] No VIF found with MAC fa:16:3e:9b:9a:f6, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:51:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] No VIF found with MAC fa:16:3e:40:b4:b3, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:51:03 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Using config drive
Apr 14 18:51:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.objects.instance [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'flavor' on Instance uuid 094a4a33-569e-4137-8798-743499f1046c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:51:05 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Creating config drive at /opt/stack/data/nova/instances/dc260db7-ffd6-4b7a-8b70-b4070478faab/disk.config
Apr 14 18:51:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/dc260db7-ffd6-4b7a-8b70-b4070478faab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpimrgadpj {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498265.0748167, 1285eca2-575b-4550-a424-605fb186b510 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1285eca2-575b-4550-a424-605fb186b510] VM Resumed (Lifecycle Event)
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.compute.manager [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received event network-vif-plugged-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] Lock "1285eca2-575b-4550-a424-605fb186b510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] Lock "1285eca2-575b-4550-a424-605fb186b510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.compute.manager [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] No waiting events found dispatching network-vif-plugged-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:05 user nova-compute[71308]: WARNING nova.compute.manager [req-7d54bb17-19bc-4993-ba84-4b447098a507 req-a3eb5fd4-55dd-423d-ad0b-249d8eb76e36 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received unexpected event network-vif-plugged-0ccfdc96-01f1-414d-8693-963f116cfd62 for instance with vm_state building and task_state spawning.
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1285eca2-575b-4550-a424-605fb186b510] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/dc260db7-ffd6-4b7a-8b70-b4070478faab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpimrgadpj" returned: 0 in 0.090s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:05 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:51:05 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7417MB free_disk=26.35448455810547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:05 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1285eca2-575b-4550-a424-605fb186b510] Instance spawned successfully.
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-22072616-d50a-494b-b3b1-07dd4d498e74 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.046s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1285eca2-575b-4550-a424-605fb186b510] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1285eca2-575b-4550-a424-605fb186b510] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498265.0764868, 1285eca2-575b-4550-a424-605fb186b510 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1285eca2-575b-4550-a424-605fb186b510] VM Started (Lifecycle Event)
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1285eca2-575b-4550-a424-605fb186b510] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1285eca2-575b-4550-a424-605fb186b510] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1285eca2-575b-4550-a424-605fb186b510] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:51:05 user nova-compute[71308]: INFO nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Took 11.17 seconds to spawn the instance on the hypervisor.
Apr 14 18:51:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 094a4a33-569e-4137-8798-743499f1046c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 817f112c-d806-4800-9e4a-a3892c54bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 482b8c77-c963-4bc1-8e3c-847650736767 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance dc260db7-ffd6-4b7a-8b70-b4070478faab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1285eca2-575b-4550-a424-605fb186b510 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:51:06 user nova-compute[71308]: INFO nova.compute.manager [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Took 12.19 seconds to build instance.
Apr 14 18:51:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c1dfba5-d282-40d5-88ac-b560bd279ec5 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.323s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:51:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.115s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:07 user nova-compute[71308]: WARNING nova.compute.manager [req-ebad2ff5-e8a1-4705-bac4-fd7897d2a334 req-0b47e28d-db8d-490d-8c37-6e8af2044799 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance with vm_state building and task_state spawning.
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:08 user nova-compute[71308]: WARNING nova.compute.manager [req-bfa8a4ec-a6e8-447d-a9a6-9537990730c6 req-7c0d719b-7f02-453a-847e-11b9cd81a4f2 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-f4fbff28-9aec-444f-aef4-a67e882a9255 for instance with vm_state building and task_state spawning.
Apr 14 18:51:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:51:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG nova.compute.manager [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG nova.compute.manager [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:09 user nova-compute[71308]: WARNING nova.compute.manager [req-53879a59-4a5d-462b-a1e9-4696d5aba5db req-be7465f0-872c-414c-bf77-7e58d75d473e service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-6dc22897-5349-4914-8ab8-eafee74a17dc for instance with vm_state building and task_state spawning.
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:10 user nova-compute[71308]: WARNING nova.compute.manager [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance with vm_state building and task_state spawning.
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:10 user nova-compute[71308]: WARNING nova.compute.manager [req-398bc6da-d6fb-4d1d-9991-ec80c74276ea req-56ec0e6f-df1e-43ad-a1d3-b0bf6a5e575f service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-2af029d9-055b-406b-a82d-a88d8b51c4fa for instance with vm_state building and task_state spawning.
Apr 14 18:51:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:10 user nova-compute[71308]: WARNING nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-f4fbff28-9aec-444f-aef4-a67e882a9255 for instance with vm_state building and task_state spawning.
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:10 user nova-compute[71308]: WARNING nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-6b1efba7-12bf-4333-a320-c76218ba1b09 for instance with vm_state building and task_state spawning.
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:10 user nova-compute[71308]: WARNING nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-6b1efba7-12bf-4333-a320-c76218ba1b09 for instance with vm_state building and task_state spawning.
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:10 user nova-compute[71308]: WARNING nova.compute.manager [req-d876f4c7-4edb-4309-8e83-6c7ae8ae42d2 req-a121f630-5ebe-4ba5-b536-c55679be9f27 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance with vm_state building and task_state spawning.
Apr 14 18:51:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:11 user nova-compute[71308]: WARNING nova.compute.manager [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-6dc22897-5349-4914-8ab8-eafee74a17dc for instance with vm_state building and task_state spawning.
Apr 14 18:51:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:11 user nova-compute[71308]: WARNING nova.compute.manager [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-bb067fd8-e349-48fe-8450-b2308b4ccdab for instance with vm_state building and task_state spawning.
Apr 14 18:51:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:11 user nova-compute[71308]: WARNING nova.compute.manager [req-d35a483c-0a72-4567-a4b3-92c6289222f8 req-696444a3-84df-47ec-8e78-d06f8fc199c4 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-bb067fd8-e349-48fe-8450-b2308b4ccdab for instance with vm_state building and task_state spawning.
Apr 14 18:51:11 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:12 user nova-compute[71308]: WARNING nova.compute.manager [req-ba5eba97-9db7-42f0-b32d-c685094db840 req-e376da8b-3f02-44b4-bb75-66fc8f79e075 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-2af029d9-055b-406b-a82d-a88d8b51c4fa for instance with vm_state building and task_state spawning.
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498272.4545536, dc260db7-ffd6-4b7a-8b70-b4070478faab => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:12 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] VM Resumed (Lifecycle Event)
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:51:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance spawned successfully.
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:12 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498272.4557939, dc260db7-ffd6-4b7a-8b70-b4070478faab => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:12 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] VM Started (Lifecycle Event)
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:12 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:51:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:12 user nova-compute[71308]: INFO nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Took 18.31 seconds to spawn the instance on the hypervisor.
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:12 user nova-compute[71308]: INFO nova.compute.manager [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Took 37.33 seconds to build instance.
Apr 14 18:51:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f42febf6-45b1-4943-9fc9-97c1f96312e5 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.506s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:12 user nova-compute[71308]: WARNING nova.compute.manager [req-44a8b9bf-a01b-43e9-902b-d72278bb476a req-b9355a91-6d7a-485b-aff3-e890a955fd35 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance with vm_state active and task_state None.
Apr 14 18:51:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing instance network info cache due to event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:51:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] Acquiring lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:51:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] Acquired lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:51:21 user nova-compute[71308]: DEBUG nova.network.neutron [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:51:22 user nova-compute[71308]: DEBUG nova.network.neutron [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updated VIF entry in instance network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:51:22 user nova-compute[71308]: DEBUG nova.network.neutron [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updating instance_info_cache with network_info: [{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7002c653-ca56-4415-9f00-d0af76d09db3 req-64412942-d7fc-4ec5-b06f-dd5ca888ae30 service nova] Releasing lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:22 user nova-compute[71308]: INFO nova.compute.manager [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Detaching volume 31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:51:22 user nova-compute[71308]: INFO nova.virt.block_device [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Attempting to driver detach volume 31ad3520-e4ab-4564-8a4f-b1f9afc6d344 from mountpoint /dev/vdb
Apr 14 18:51:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Attempting to detach device vdb from instance 656b9f90-ce93-42cd-aa1b-3ff868162aae from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:51:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:51:22 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:51:22 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 18:51:22 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:51:22 user nova-compute[71308]:   <serial>31ad3520-e4ab-4564-8a4f-b1f9afc6d344</serial>
Apr 14 18:51:22 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 18:51:22 user nova-compute[71308]: </disk>
Apr 14 18:51:22 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:51:22 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully detached device vdb from instance 656b9f90-ce93-42cd-aa1b-3ff868162aae from the persistent domain config.
Apr 14 18:51:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 656b9f90-ce93-42cd-aa1b-3ff868162aae from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:51:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:51:22 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:51:22 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 18:51:22 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:51:22 user nova-compute[71308]:   <serial>31ad3520-e4ab-4564-8a4f-b1f9afc6d344</serial>
Apr 14 18:51:22 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 18:51:22 user nova-compute[71308]: </disk>
Apr 14 18:51:22 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498283.4460588, 656b9f90-ce93-42cd-aa1b-3ff868162aae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:51:23 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully detached device vdb from instance 656b9f90-ce93-42cd-aa1b-3ff868162aae from the live domain config.
Apr 14 18:51:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkIoRtub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:51:23 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing instance network info cache due to event network-changed-324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] Acquiring lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] Acquired lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG nova.network.neutron [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Refreshing network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc17748-ca15-42ab-bc3b-591ff4877720]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:51:23 user nova-compute[71308]: No targets found.
Apr 14 18:51:23 user nova-compute[71308]: iSNS:
Apr 14 18:51:23 user nova-compute[71308]: No targets found.
Apr 14 18:51:23 user nova-compute[71308]: STATIC:
Apr 14 18:51:23 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71
Apr 14 18:51:23 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:23 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:23 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd
Apr 14 18:51:23 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:23 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:23 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993
Apr 14 18:51:23 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:23 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:23 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344
Apr 14 18:51:23 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:23 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:23 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90
Apr 14 18:51:23 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:23 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:23 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490
Apr 14 18:51:23 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:23 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:23 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:51:23 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:51:23 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:51:23 user nova-compute[71308]: FIRMWARE:
Apr 14 18:51:23 user nova-compute[71308]: No targets found.
Apr 14 18:51:23 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:51:23 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:51:23 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[70016680-3b02-4886-be11-a31e2db10c01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f86fe59-a236-47c0-8cff-1372ecbe4320]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:23 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22307857e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6549411f-51e3-42a2-9d56-4d063981a931]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[de521cef-4a5a-471d-8230-90b645b9b3dc]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8d233a-7f46-4b82-81e5-cf9f67dc8066]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b3e6fb-6961-4bed-969d-f08161190504]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[418104ba-4d46-480b-ba4d-152274c558e1]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0999b9a-daae-4c20-962a-029c20ff4955]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260]
Apr 14 18:51:23 user nova-compute[71308]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344, portal: 172.16.0.220,3260] successful.
Apr 14 18:51:23 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31ad3520-e4ab-4564-8a4f-b1f9afc6d344 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62b4b35-8b3d-4af1-ba70-dde9aef9acb0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] <== disconnect_volume: return (391ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:51:23 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:51:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updated VIF entry in instance network info cache for port 324b6810-d265-48bc-a2a9-ff7d4759a910. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:51:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updating instance_info_cache with network_info: [{"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-28f8d48a-a063-4296-a87f-bb2aec9296d1 req-32a9f6cc-90f1-44c5-b282-01512e735e6d service nova] Releasing lock "refresh_cache-656b9f90-ce93-42cd-aa1b-3ff868162aae" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:24 user nova-compute[71308]: DEBUG nova.objects.instance [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'flavor' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:51:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4e585145-24f2-499a-a29e-39c469faf30c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.222s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "482b8c77-c963-4bc1-8e3c-847650736767" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "482b8c77-c963-4bc1-8e3c-847650736767" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "482b8c77-c963-4bc1-8e3c-847650736767-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:28 user nova-compute[71308]: INFO nova.compute.manager [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Terminating instance
Apr 14 18:51:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received event network-vif-unplugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] Acquiring lock "482b8c77-c963-4bc1-8e3c-847650736767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] No waiting events found dispatching network-vif-unplugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-e61bda23-2f6f-4fad-b8a7-144c18961aaa req-d7a17c10-e4ef-4737-90e6-a828e5f8ee5c service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received event network-vif-unplugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:51:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Instance destroyed successfully.
Apr 14 18:51:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'resources' on Instance uuid 482b8c77-c963-4bc1-8e3c-847650736767 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-810776822',display_name='tempest-VolumesAdminNegativeTest-server-810776822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-810776822',id=15,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d22a362d9cb946a99c203366f88baafb',ramdisk_id='',reservation_id='r-wg9x4ti5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-714849235',owner_user_name='tempest-VolumesAdminNegativeTest-714849235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:49:43Z,user_data=None,user_id='3f78850ecd8042dbac5f24113b9df70e',uuid=482b8c77-c963-4bc1-8e3c-847650736767,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converting VIF {"id": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "address": "fa:16:3e:63:8a:da", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38af2537-56", "ovs_interfaceid": "38af2537-567f-4c06-b8f5-6e0c46f8dde6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=38af2537-567f-4c06-b8f5-6e0c46f8dde6,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38af2537-56') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG os_vif [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=38af2537-567f-4c06-b8f5-6e0c46f8dde6,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38af2537-56') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38af2537-56, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:29 user nova-compute[71308]: INFO os_vif [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8a:da,bridge_name='br-int',has_traffic_filtering=True,id=38af2537-567f-4c06-b8f5-6e0c46f8dde6,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38af2537-56')
Apr 14 18:51:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Deleting instance files /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767_del
Apr 14 18:51:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Deletion of /opt/stack/data/nova/instances/482b8c77-c963-4bc1-8e3c-847650736767_del complete
Apr 14 18:51:29 user nova-compute[71308]: INFO nova.compute.manager [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 14 18:51:29 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:51:29 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:31 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Took 1.12 seconds to deallocate network for instance.
Apr 14 18:51:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received event network-vif-plugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] Acquiring lock "482b8c77-c963-4bc1-8e3c-847650736767-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] Lock "482b8c77-c963-4bc1-8e3c-847650736767-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] No waiting events found dispatching network-vif-plugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:31 user nova-compute[71308]: WARNING nova.compute.manager [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received unexpected event network-vif-plugged-38af2537-567f-4c06-b8f5-6e0c46f8dde6 for instance with vm_state deleted and task_state None.
Apr 14 18:51:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-ac1e99b8-a620-4087-b6c7-56735931243a req-df936c1e-8a55-457c-8833-67829344ba5e service nova] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Received event network-vif-deleted-38af2537-567f-4c06-b8f5-6e0c46f8dde6 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:51:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:31 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Deleted allocations for instance 482b8c77-c963-4bc1-8e3c-847650736767
Apr 14 18:51:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-60ed86f6-725a-4841-b81d-47b84d7d9ea5 tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "482b8c77-c963-4bc1-8e3c-847650736767" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.982s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:51:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:51:32 user nova-compute[71308]: INFO nova.compute.claims [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Claim successful on node user
Apr 14 18:51:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:51:33 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:51:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG nova.policy [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:51:33 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Creating image(s)
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "/opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "/opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "/opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.217s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk 1073741824" returned: 0 in 0.057s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.263s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Cannot resize image /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'migration_context' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Ensure instance console log exists: /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Successfully created port: 2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:51:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:35 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Successfully updated port: 2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:51:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:51:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquired lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:51:35 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:51:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-changed-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Refreshing instance network info cache due to event network-changed-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:51:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] Acquiring lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:51:35 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updating instance_info_cache with network_info: [{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Releasing lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance network_info: |[{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] Acquired lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.network.neutron [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Refreshing network info cache for port 2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Start _get_guest_xml network_info=[{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:51:36 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:51:36 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1892211249',display_name='tempest-AttachVolumeTestJSON-server-1892211249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1892211249',id=20,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA==',key_name='tempest-keypair-1957519464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-h1jd70xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=0050e6bb-0b53-4fdc-8437-16b94ee79fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'pci_devices' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:51:36 user nova-compute[71308]:   <uuid>0050e6bb-0b53-4fdc-8437-16b94ee79fa4</uuid>
Apr 14 18:51:36 user nova-compute[71308]:   <name>instance-00000014</name>
Apr 14 18:51:36 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:51:36 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:51:36 user nova-compute[71308]:   <metadata>
Apr 14 18:51:36 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:51:36 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:51:36 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeTestJSON-server-1892211249</nova:name>
Apr 14 18:51:36 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:51:36</nova:creationTime>
Apr 14 18:51:36 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:51:36 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:51:36 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:51:36 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:51:36 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:51:36 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:51:36 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:51:36 user nova-compute[71308]:       <nova:owner>
Apr 14 18:51:36 user nova-compute[71308]:         <nova:user uuid="9f90c8f23e3b42a98fdb9261db65f547">tempest-AttachVolumeTestJSON-1126291015-project-member</nova:user>
Apr 14 18:51:36 user nova-compute[71308]:         <nova:project uuid="edf25bcc0dea4d3eb1284e8995eb3466">tempest-AttachVolumeTestJSON-1126291015</nova:project>
Apr 14 18:51:36 user nova-compute[71308]:       </nova:owner>
Apr 14 18:51:36 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:51:36 user nova-compute[71308]:       <nova:ports>
Apr 14 18:51:36 user nova-compute[71308]:         <nova:port uuid="2dd49e6c-3f3a-4124-aff8-a4a4e898cf21">
Apr 14 18:51:36 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 18:51:36 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:36 user nova-compute[71308]:       </nova:ports>
Apr 14 18:51:36 user nova-compute[71308]:     </nova:instance>
Apr 14 18:51:36 user nova-compute[71308]:   </metadata>
Apr 14 18:51:36 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:51:36 user nova-compute[71308]:     <system>
Apr 14 18:51:36 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:51:36 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:51:36 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:51:36 user nova-compute[71308]:       <entry name="serial">0050e6bb-0b53-4fdc-8437-16b94ee79fa4</entry>
Apr 14 18:51:36 user nova-compute[71308]:       <entry name="uuid">0050e6bb-0b53-4fdc-8437-16b94ee79fa4</entry>
Apr 14 18:51:36 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:51:36 user nova-compute[71308]:     </system>
Apr 14 18:51:36 user nova-compute[71308]:   </sysinfo>
Apr 14 18:51:36 user nova-compute[71308]:   <os>
Apr 14 18:51:36 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:51:36 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:51:36 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:51:36 user nova-compute[71308]:   </os>
Apr 14 18:51:36 user nova-compute[71308]:   <features>
Apr 14 18:51:36 user nova-compute[71308]:     <acpi/>
Apr 14 18:51:36 user nova-compute[71308]:     <apic/>
Apr 14 18:51:36 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:51:36 user nova-compute[71308]:   </features>
Apr 14 18:51:36 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:51:36 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:51:36 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:51:36 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:51:36 user nova-compute[71308]:   </clock>
Apr 14 18:51:36 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:51:36 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:51:36 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:51:36 user nova-compute[71308]:   </cpu>
Apr 14 18:51:36 user nova-compute[71308]:   <devices>
Apr 14 18:51:36 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:51:36 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:51:36 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk"/>
Apr 14 18:51:36 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:51:36 user nova-compute[71308]:     </disk>
Apr 14 18:51:36 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:36 user nova-compute[71308]:       <mac address="fa:16:3e:18:06:fd"/>
Apr 14 18:51:36 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:36 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:36 user nova-compute[71308]:       <target dev="tap2dd49e6c-3f"/>
Apr 14 18:51:36 user nova-compute[71308]:     </interface>
Apr 14 18:51:36 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:51:36 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/console.log" append="off"/>
Apr 14 18:51:36 user nova-compute[71308]:     </serial>
Apr 14 18:51:36 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:51:36 user nova-compute[71308]:     <video>
Apr 14 18:51:36 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:36 user nova-compute[71308]:     </video>
Apr 14 18:51:36 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:51:36 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:51:36 user nova-compute[71308]:     </rng>
Apr 14 18:51:36 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:51:36 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:51:36 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:51:36 user nova-compute[71308]:     </memballoon>
Apr 14 18:51:36 user nova-compute[71308]:   </devices>
Apr 14 18:51:36 user nova-compute[71308]: </domain>
Apr 14 18:51:36 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1892211249',display_name='tempest-AttachVolumeTestJSON-server-1892211249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1892211249',id=20,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA==',key_name='tempest-keypair-1957519464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-h1jd70xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=0050e6bb-0b53-4fdc-8437-16b94ee79fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG os_vif [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd49e6c-3f, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dd49e6c-3f, col_values=(('external_ids', {'iface-id': '2dd49e6c-3f3a-4124-aff8-a4a4e898cf21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:06:fd', 'vm-uuid': '0050e6bb-0b53-4fdc-8437-16b94ee79fa4'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:36 user nova-compute[71308]: INFO os_vif [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f')
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:51:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No VIF found with MAC fa:16:3e:18:06:fd, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:51:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:37 user nova-compute[71308]: DEBUG nova.network.neutron [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updated VIF entry in instance network info cache for port 2dd49e6c-3f3a-4124-aff8-a4a4e898cf21. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:51:37 user nova-compute[71308]: DEBUG nova.network.neutron [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updating instance_info_cache with network_info: [{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-33863740-7d68-40d4-a9dc-21f5f1ee9426 req-091b1d54-0a29-42b1-98ba-5af36eacb072 service nova] Releasing lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:38 user nova-compute[71308]: DEBUG nova.compute.manager [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:38 user nova-compute[71308]: DEBUG nova.compute.manager [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:38 user nova-compute[71308]: WARNING nova.compute.manager [req-0d2e79de-57d9-4174-b828-c076e8970fd8 req-288f9230-04ae-499a-bfbb-69d98f22651a service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state building and task_state spawning.
Apr 14 18:51:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498300.2540178, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:40 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] VM Resumed (Lifecycle Event)
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:51:40 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance spawned successfully.
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:40 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498300.2583811, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:40 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] VM Started (Lifecycle Event)
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:40 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:51:40 user nova-compute[71308]: INFO nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Took 6.98 seconds to spawn the instance on the hypervisor.
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:40 user nova-compute[71308]: INFO nova.compute.manager [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Took 7.73 seconds to build instance.
Apr 14 18:51:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8c182ee2-ef5b-4940-8f21-dbea1b501486 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.839s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:40 user nova-compute[71308]: WARNING nova.compute.manager [req-1ba9914a-4457-4d75-a2f3-80602406f86d req-31fd3733-68d1-4bdc-bf4d-bc4a08b14b70 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state active and task_state None.
Apr 14 18:51:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:44 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498289.6929188, 482b8c77-c963-4bc1-8e3c-847650736767 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:44 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] VM Stopped (Lifecycle Event)
Apr 14 18:51:44 user nova-compute[71308]: DEBUG nova.compute.manager [None req-cd0b198a-6610-433f-9b8b-52dfe83b8b60 None None] [instance: 482b8c77-c963-4bc1-8e3c-847650736767] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:51:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:47 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:51:47 user nova-compute[71308]: INFO nova.compute.claims [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Claim successful on node user
Apr 14 18:51:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG nova.network.neutron [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:51:48 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:51:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:51:48 user nova-compute[71308]: INFO nova.virt.block_device [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Booting with volume bbbfd96c-e671-4f85-8956-985a620429f4 at /dev/vda
Apr 14 18:51:48 user nova-compute[71308]: DEBUG nova.policy [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10e3f2dda9bc49f48c66beb978dbdaca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0091007734312b8d33caf294d2c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG os_brick.utils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[da78520b-0c6f-44ce-bf61-6230057699e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81cd8b6-e2d3-4d78-acfb-cd83f3f83b00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe511ba-c570-4343-ae4d-a60bca2906da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5331f4-70ba-454b-99c6-23ebb91cbda3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:51:48 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:51:48 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa0b015-1d2f-408e-a76b-9a405bdd481a]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG os_brick.utils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:51:48 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating existing volume attachment record: e3fc1a44-4cca-4290-988a-773bc258a556 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:51:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Successfully created port: ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG nova.network.neutron [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Successfully updated port: ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquired lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG nova.network.neutron [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing instance network info cache due to event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] Acquiring lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG nova.network.neutron [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG nova.network.neutron [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Releasing lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Instance network_info: |[{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] Acquired lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:51:50 user nova-compute[71308]: DEBUG nova.network.neutron [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updated VIF entry in instance network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bf5edf27-1a88-4783-87d1-d2f5c0492331 req-9613ee4f-7224-4eaa-bd85-17a0f711c73c service nova] Releasing lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:51 user nova-compute[71308]: INFO nova.compute.manager [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Terminating instance
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received event network-vif-unplugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] Lock "094a4a33-569e-4137-8798-743499f1046c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] Lock "094a4a33-569e-4137-8798-743499f1046c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] No waiting events found dispatching network-vif-unplugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-962de664-5424-471f-b990-f1fa6e682802 req-74eaa392-30d6-4df1-9aa9-2287b5d9061d service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received event network-vif-unplugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 094a4a33-569e-4137-8798-743499f1046c] Instance destroyed successfully.
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.objects.instance [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'resources' on Instance uuid 094a4a33-569e-4137-8798-743499f1046c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-215795382',display_name='tempest-AttachVolumeNegativeTest-server-215795382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-215795382',id=3,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcnNYGBRk0T6UxqrAha7Z7Vc1FFjiy6Mjj7iMKuh2Pb5hXRv1c3o+L8zfJZoZltWQ/PaAHBztxQ47uQg4w2vJU1ykAEMJkmmLwbyLyAWrDxacAv1mprhptr2nQm4buAkw==',key_name='tempest-keypair-275380641',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-4w5nbibl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=094a4a33-569e-4137-8798-743499f1046c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "address": "fa:16:3e:84:f7:b1", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap940c6edd-6f", "ovs_interfaceid": "940c6edd-6fc7-4e88-92b4-38a62e88f2ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=940c6edd-6fc7-4e88-92b4-38a62e88f2ab,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940c6edd-6f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG os_vif [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=940c6edd-6fc7-4e88-92b4-38a62e88f2ab,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940c6edd-6f') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap940c6edd-6f, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:51 user nova-compute[71308]: INFO os_vif [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:f7:b1,bridge_name='br-int',has_traffic_filtering=True,id=940c6edd-6fc7-4e88-92b4-38a62e88f2ab,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940c6edd-6f')
Apr 14 18:51:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Deleting instance files /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c_del
Apr 14 18:51:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Deletion of /opt/stack/data/nova/instances/094a4a33-569e-4137-8798-743499f1046c_del complete
Apr 14 18:51:52 user nova-compute[71308]: INFO nova.compute.manager [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 094a4a33-569e-4137-8798-743499f1046c] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 18:51:52 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:51:52 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 094a4a33-569e-4137-8798-743499f1046c] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:51:52 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 094a4a33-569e-4137-8798-743499f1046c] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:51:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 094a4a33-569e-4137-8798-743499f1046c] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:51:53 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 094a4a33-569e-4137-8798-743499f1046c] Took 1.44 seconds to deallocate network for instance.
Apr 14 18:51:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-262e4c27-3ce6-4db7-9b74-56159b85487b req-4899aa73-522d-4eb8-86e3-e3af2dfb5413 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received event network-vif-deleted-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received event network-vif-plugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] Acquiring lock "094a4a33-569e-4137-8798-743499f1046c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] Lock "094a4a33-569e-4137-8798-743499f1046c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] Lock "094a4a33-569e-4137-8798-743499f1046c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] No waiting events found dispatching network-vif-plugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:53 user nova-compute[71308]: WARNING nova.compute.manager [req-172cee56-aaa2-4d55-a7a9-75ffb73ccb7f req-ae1e0bab-66a2-4a49-89f6-ce78173ec0b4 service nova] [instance: 094a4a33-569e-4137-8798-743499f1046c] Received unexpected event network-vif-plugged-940c6edd-6fc7-4e88-92b4-38a62e88f2ab for instance with vm_state deleted and task_state None.
Apr 14 18:51:53 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:51:53 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:51:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Creating image(s)
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Ensure instance console log exists: /opt/stack/data/nova/instances/a2a860bd-802f-4760-b77b-92b7ac4ad09b/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Start _get_guest_xml network_info=[{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'e3fc1a44-4cca-4290-988a-773bc258a556', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWzfbaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a2a860bd-802f-4760-b77b-92b7ac4ad09b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bbbfd96c-e671-4f85-8956-985a620429f4', 'serial': 'bbbfd96c-e671-4f85-8956-985a620429f4'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:51:54 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Deleted allocations for instance 094a4a33-569e-4137-8798-743499f1046c
Apr 14 18:51:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:51:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWzfbaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:51:54 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:51:54 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:51:54 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f85c68-f476-483b-80fb-24c7bb912590]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:51:54 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a950d8-d2d9-44df-b9bd-ce3104b79986]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4] added
Apr 14 18:51:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-56edbfca-1faf-4ae9-bb73-1e6acf961066 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "094a4a33-569e-4137-8798-743499f1046c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86c8223-576a-407f-b98a-eea819847890]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d6388d-7229-4f5a-80b9-4735bfaf1396]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkWzfbaw {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkWzfbaw" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ad815c-6f25-40b4-95d5-dd11807824cc]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lkWzfbaw'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4bcbe0-480a-4c74-9c93-0c610b83f7c0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[40119093-64ad-4cc0-8f7e-78513ab5d524]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d0fbf8-363e-4c9a-908d-084c259c3e21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260]
Apr 14 18:51:54 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260] successful.
Apr 14 18:51:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[791ea0d2-210f-4e57-9013-770bfc7ec956]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f11f3f-0bd6-4d3d-9301-619839eb37ac]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:51:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[751794fb-c99c-4497-9bbb-c380ef32b4cf]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:51:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWzfbaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23363303235363164', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363303235363164', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-268762116',display_name='tempest-TestShelveInstance-server-268762116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-268762116',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx6ahRgtQXPgUyewJCWpWITHQipTZzs9c0P8Aj7ZCbMBMa2yXyDTXsh+XmK3wGceblEWwvvTYvKODXsclHUqQnjkGng7EfdTyYzxpc1qTSqvnJNTDFtuZ+jiMrT7Wx64g==',key_name='tempest-TestShelveInstance-756134745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d0091007734312b8d33caf294d2c65',ramdisk_id='',reservation_id='r-sf7xh3dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-48517904',owner_user_name='tempest-TestShelveInstance-48517904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:51:48Z,user_data=None,user_id='10e3f2dda9bc49f48c66beb978dbdaca',uuid=a2a860bd-802f-4760-b77b-92b7ac4ad09b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converting VIF {"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.objects.instance [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lazy-loading 'pci_devices' on Instance uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:51:55 user nova-compute[71308]:   <uuid>a2a860bd-802f-4760-b77b-92b7ac4ad09b</uuid>
Apr 14 18:51:55 user nova-compute[71308]:   <name>instance-00000015</name>
Apr 14 18:51:55 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:51:55 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:51:55 user nova-compute[71308]:   <metadata>
Apr 14 18:51:55 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:51:55 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:51:55 user nova-compute[71308]:       <nova:name>tempest-TestShelveInstance-server-268762116</nova:name>
Apr 14 18:51:55 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:51:54</nova:creationTime>
Apr 14 18:51:55 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:51:55 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:51:55 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:51:55 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:51:55 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:51:55 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:51:55 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:51:55 user nova-compute[71308]:       <nova:owner>
Apr 14 18:51:55 user nova-compute[71308]:         <nova:user uuid="10e3f2dda9bc49f48c66beb978dbdaca">tempest-TestShelveInstance-48517904-project-member</nova:user>
Apr 14 18:51:55 user nova-compute[71308]:         <nova:project uuid="46d0091007734312b8d33caf294d2c65">tempest-TestShelveInstance-48517904</nova:project>
Apr 14 18:51:55 user nova-compute[71308]:       </nova:owner>
Apr 14 18:51:55 user nova-compute[71308]:       <nova:ports>
Apr 14 18:51:55 user nova-compute[71308]:         <nova:port uuid="ce6fcefe-d72a-4cb7-8564-65fd4dcd0293">
Apr 14 18:51:55 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 18:51:55 user nova-compute[71308]:         </nova:port>
Apr 14 18:51:55 user nova-compute[71308]:       </nova:ports>
Apr 14 18:51:55 user nova-compute[71308]:     </nova:instance>
Apr 14 18:51:55 user nova-compute[71308]:   </metadata>
Apr 14 18:51:55 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:51:55 user nova-compute[71308]:     <system>
Apr 14 18:51:55 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:51:55 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:51:55 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:51:55 user nova-compute[71308]:       <entry name="serial">a2a860bd-802f-4760-b77b-92b7ac4ad09b</entry>
Apr 14 18:51:55 user nova-compute[71308]:       <entry name="uuid">a2a860bd-802f-4760-b77b-92b7ac4ad09b</entry>
Apr 14 18:51:55 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:51:55 user nova-compute[71308]:     </system>
Apr 14 18:51:55 user nova-compute[71308]:   </sysinfo>
Apr 14 18:51:55 user nova-compute[71308]:   <os>
Apr 14 18:51:55 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:51:55 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:51:55 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:51:55 user nova-compute[71308]:   </os>
Apr 14 18:51:55 user nova-compute[71308]:   <features>
Apr 14 18:51:55 user nova-compute[71308]:     <acpi/>
Apr 14 18:51:55 user nova-compute[71308]:     <apic/>
Apr 14 18:51:55 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:51:55 user nova-compute[71308]:   </features>
Apr 14 18:51:55 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:51:55 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:51:55 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:51:55 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:51:55 user nova-compute[71308]:   </clock>
Apr 14 18:51:55 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:51:55 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:51:55 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:51:55 user nova-compute[71308]:   </cpu>
Apr 14 18:51:55 user nova-compute[71308]:   <devices>
Apr 14 18:51:55 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:51:55 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:51:55 user nova-compute[71308]:       <source dev="/dev/sdb"/>
Apr 14 18:51:55 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:51:55 user nova-compute[71308]:       <serial>bbbfd96c-e671-4f85-8956-985a620429f4</serial>
Apr 14 18:51:55 user nova-compute[71308]:     </disk>
Apr 14 18:51:55 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:51:55 user nova-compute[71308]:       <mac address="fa:16:3e:e4:5d:2c"/>
Apr 14 18:51:55 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:55 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:51:55 user nova-compute[71308]:       <target dev="tapce6fcefe-d7"/>
Apr 14 18:51:55 user nova-compute[71308]:     </interface>
Apr 14 18:51:55 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:51:55 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/a2a860bd-802f-4760-b77b-92b7ac4ad09b/console.log" append="off"/>
Apr 14 18:51:55 user nova-compute[71308]:     </serial>
Apr 14 18:51:55 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:51:55 user nova-compute[71308]:     <video>
Apr 14 18:51:55 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:51:55 user nova-compute[71308]:     </video>
Apr 14 18:51:55 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:51:55 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:51:55 user nova-compute[71308]:     </rng>
Apr 14 18:51:55 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:51:55 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:51:55 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:51:55 user nova-compute[71308]:     </memballoon>
Apr 14 18:51:55 user nova-compute[71308]:   </devices>
Apr 14 18:51:55 user nova-compute[71308]: </domain>
Apr 14 18:51:55 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-268762116',display_name='tempest-TestShelveInstance-server-268762116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-268762116',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx6ahRgtQXPgUyewJCWpWITHQipTZzs9c0P8Aj7ZCbMBMa2yXyDTXsh+XmK3wGceblEWwvvTYvKODXsclHUqQnjkGng7EfdTyYzxpc1qTSqvnJNTDFtuZ+jiMrT7Wx64g==',key_name='tempest-TestShelveInstance-756134745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d0091007734312b8d33caf294d2c65',ramdisk_id='',reservation_id='r-sf7xh3dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-48517904',owner_user_name='tempest-TestShelveInstance-48517904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:51:48Z,user_data=None,user_id='10e3f2dda9bc49f48c66beb978dbdaca',uuid=a2a860bd-802f-4760-b77b-92b7ac4ad09b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converting VIF {"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG os_vif [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce6fcefe-d7, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce6fcefe-d7, col_values=(('external_ids', {'iface-id': 'ce6fcefe-d72a-4cb7-8564-65fd4dcd0293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:5d:2c', 'vm-uuid': 'a2a860bd-802f-4760-b77b-92b7ac4ad09b'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:55 user nova-compute[71308]: INFO os_vif [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7')
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:51:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] No VIF found with MAC fa:16:3e:e4:5d:2c, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:51:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] No waiting events found dispatching network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:57 user nova-compute[71308]: WARNING nova.compute.manager [req-f3942fde-1705-4be8-9179-6b9e85338d8c req-6f324471-a15d-47eb-b4c9-a40d74e5edbe service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received unexpected event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance with vm_state building and task_state spawning.
Apr 14 18:51:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:51:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71308) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 18:51:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:51:58 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] No waiting events found dispatching network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:51:59 user nova-compute[71308]: WARNING nova.compute.manager [req-c1489cc6-5ef9-4df3-a97e-e0ff55a628a9 req-a8a029ba-ba2f-43f2-9681-9ac67e318142 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received unexpected event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance with vm_state building and task_state spawning.
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498319.5412009, a2a860bd-802f-4760-b77b-92b7ac4ad09b => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] VM Resumed (Lifecycle Event)
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:51:59 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Instance spawned successfully.
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:51:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498319.5421598, a2a860bd-802f-4760-b77b-92b7ac4ad09b => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:51:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] VM Started (Lifecycle Event)
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:51:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:51:59 user nova-compute[71308]: INFO nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 14 18:51:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:51:59 user nova-compute[71308]: INFO nova.compute.manager [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Took 11.92 seconds to build instance.
Apr 14 18:51:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99e69256-43b3-44e5-9f70-c4804765242b tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.024s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:00 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:00 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:01 user nova-compute[71308]: INFO nova.compute.manager [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Unrescuing
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquired lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:52:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating instance_info_cache with network_info: [{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Releasing lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'flavor' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-changed-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Refreshing instance network info cache due to event network-changed-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] Acquiring lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] Acquired lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG nova.network.neutron [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Refreshing network info cache for port 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:03 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Instance destroyed successfully.
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG nova.network.neutron [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updated VIF entry in instance network info cache for port 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG nova.network.neutron [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating instance_info_cache with network_info: [{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-afa68d5e-787c-4cb4-8f3d-0b5c9b7e2c15 req-ef517a61-507b-48f2-b310-d5ce61a5c510 service nova] Releasing lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-changed-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Refreshing instance network info cache due to event network-changed-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Acquiring lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Acquired lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG nova.network.neutron [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Refreshing network info cache for port 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498311.8961148, 094a4a33-569e-4137-8798-743499f1046c => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:07 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 094a4a33-569e-4137-8798-743499f1046c] VM Stopped (Lifecycle Event)
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:07 user nova-compute[71308]: WARNING nova.compute.manager [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:07 user nova-compute[71308]: WARNING nova.compute.manager [req-c2e0cffd-6b7f-4808-b829-8d7f2cd195c2 req-d65a7ed8-29f6-430a-8fbb-edb4c489de27 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 8e55c721-9fad-4478-9e74-e87d0c95bc3c due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498327.0376902, 8e55c721-9fad-4478-9e74-e87d0c95bc3c => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:07 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] VM Resumed (Lifecycle Event)
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f13f1900-86a6-4fc8-a83e-9bfb266586f9 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-aefbddc7-1f48-442c-8c52-4066b5574819 None None] [instance: 094a4a33-569e-4137-8798-743499f1046c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:52:07 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:52:07 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7101MB free_disk=26.320209503173828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:07 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498327.0401516, 8e55c721-9fad-4478-9e74-e87d0c95bc3c => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:07 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] VM Started (Lifecycle Event)
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 817f112c-d806-4800-9e4a-a3892c54bee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 656b9f90-ce93-42cd-aa1b-3ff868162aae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance dc260db7-ffd6-4b7a-8b70-b4070478faab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1285eca2-575b-4550-a424-605fb186b510 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.network.neutron [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updated VIF entry in instance network info cache for port 66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.network.neutron [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating instance_info_cache with network_info: [{"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Releasing lock "refresh_cache-8e55c721-9fad-4478-9e74-e87d0c95bc3c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-unplugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-unplugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:07 user nova-compute[71308]: WARNING nova.compute.manager [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-unplugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.manager [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:07 user nova-compute[71308]: WARNING nova.compute.manager [req-ae4d078d-2bda-4061-85de-ca079a41b799 req-9a77ed7e-c20f-4590-992e-873dcecfabbd service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing inventories for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating ProviderTree inventory for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating inventory in ProviderTree for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 18:52:07 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing aggregate associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, aggregates: None {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing trait associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.926s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] There are 0 instances to clean {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 18:52:08 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:09 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:52:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:52:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:52:09 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:52:10 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Updating instance_info_cache with network_info: [{"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-817f112c-d806-4800-9e4a-a3892c54bee1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:52:10 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:52:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:10 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:52:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:13 user nova-compute[71308]: INFO nova.compute.manager [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Rescuing
Apr 14 18:52:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:52:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquired lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:52:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Updating instance_info_cache with network_info: [{"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Releasing lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-unplugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] No waiting events found dispatching network-vif-unplugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:14 user nova-compute[71308]: WARNING nova.compute.manager [req-031f8266-da4e-4945-92ec-7f2aa358aec4 req-12578d9b-96fb-4dce-99a0-a4dbdabc835b service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received unexpected event network-vif-unplugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance with vm_state active and task_state rescuing.
Apr 14 18:52:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Instance destroyed successfully.
Apr 14 18:52:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Attempting rescue
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71308) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Instance directory exists: not creating {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 18:52:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Creating image(s)
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'trusted_certs' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue" returned: 0 in 0.051s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'migration_context' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Start _get_guest_xml network_info=[{"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "vif_mac": "fa:16:3e:2c:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:52:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'resources' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'numa_topology' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:52:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'vcpu_model' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-502749594',display_name='tempest-ServerRescueNegativeTestJSON-server-502749594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-502749594',id=17,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-ien3h5pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:34Z,user_data=None,user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=cf640f3e-3d77-46ee-8a11-e0bdc870ff97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "vif_mac": "fa:16:3e:2c:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "vif_mac": "fa:16:3e:2c:ac:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=ee0e2f74-c744-41ec-b3f8-c7d124c61f8e,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e2f74-c7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'pci_devices' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:52:15 user nova-compute[71308]:   <uuid>cf640f3e-3d77-46ee-8a11-e0bdc870ff97</uuid>
Apr 14 18:52:15 user nova-compute[71308]:   <name>instance-00000011</name>
Apr 14 18:52:15 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:52:15 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:52:15 user nova-compute[71308]:   <metadata>
Apr 14 18:52:15 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:52:15 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:52:15 user nova-compute[71308]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-502749594</nova:name>
Apr 14 18:52:15 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:52:15</nova:creationTime>
Apr 14 18:52:15 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:52:15 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:52:15 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:52:15 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:52:15 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:52:15 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:52:15 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:52:15 user nova-compute[71308]:       <nova:owner>
Apr 14 18:52:15 user nova-compute[71308]:         <nova:user uuid="c8713ed85ffb4446847f5ded4bc2e399">tempest-ServerRescueNegativeTestJSON-1174646715-project-member</nova:user>
Apr 14 18:52:15 user nova-compute[71308]:         <nova:project uuid="e60e8abd123e414f847c68ba72894689">tempest-ServerRescueNegativeTestJSON-1174646715</nova:project>
Apr 14 18:52:15 user nova-compute[71308]:       </nova:owner>
Apr 14 18:52:15 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:52:15 user nova-compute[71308]:       <nova:ports>
Apr 14 18:52:15 user nova-compute[71308]:         <nova:port uuid="ee0e2f74-c744-41ec-b3f8-c7d124c61f8e">
Apr 14 18:52:15 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 18:52:15 user nova-compute[71308]:         </nova:port>
Apr 14 18:52:15 user nova-compute[71308]:       </nova:ports>
Apr 14 18:52:15 user nova-compute[71308]:     </nova:instance>
Apr 14 18:52:15 user nova-compute[71308]:   </metadata>
Apr 14 18:52:15 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:52:15 user nova-compute[71308]:     <system>
Apr 14 18:52:15 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:52:15 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:52:15 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:52:15 user nova-compute[71308]:       <entry name="serial">cf640f3e-3d77-46ee-8a11-e0bdc870ff97</entry>
Apr 14 18:52:15 user nova-compute[71308]:       <entry name="uuid">cf640f3e-3d77-46ee-8a11-e0bdc870ff97</entry>
Apr 14 18:52:15 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:52:15 user nova-compute[71308]:     </system>
Apr 14 18:52:15 user nova-compute[71308]:   </sysinfo>
Apr 14 18:52:15 user nova-compute[71308]:   <os>
Apr 14 18:52:15 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:52:15 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:52:15 user nova-compute[71308]:   </os>
Apr 14 18:52:15 user nova-compute[71308]:   <features>
Apr 14 18:52:15 user nova-compute[71308]:     <acpi/>
Apr 14 18:52:15 user nova-compute[71308]:     <apic/>
Apr 14 18:52:15 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:52:15 user nova-compute[71308]:   </features>
Apr 14 18:52:15 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:52:15 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:52:15 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:52:15 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:52:15 user nova-compute[71308]:   </clock>
Apr 14 18:52:15 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:52:15 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:52:15 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:52:15 user nova-compute[71308]:   </cpu>
Apr 14 18:52:15 user nova-compute[71308]:   <devices>
Apr 14 18:52:15 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:52:15 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:52:15 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue"/>
Apr 14 18:52:15 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:52:15 user nova-compute[71308]:     </disk>
Apr 14 18:52:15 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:52:15 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:52:15 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk"/>
Apr 14 18:52:15 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:52:15 user nova-compute[71308]:     </disk>
Apr 14 18:52:15 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:52:15 user nova-compute[71308]:       <mac address="fa:16:3e:2c:ac:1c"/>
Apr 14 18:52:15 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:52:15 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:52:15 user nova-compute[71308]:       <target dev="tapee0e2f74-c7"/>
Apr 14 18:52:15 user nova-compute[71308]:     </interface>
Apr 14 18:52:15 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:52:15 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/console.log" append="off"/>
Apr 14 18:52:15 user nova-compute[71308]:     </serial>
Apr 14 18:52:15 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:52:15 user nova-compute[71308]:     <video>
Apr 14 18:52:15 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:52:15 user nova-compute[71308]:     </video>
Apr 14 18:52:15 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:52:15 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:52:15 user nova-compute[71308]:     </rng>
Apr 14 18:52:15 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:52:15 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:52:15 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:52:15 user nova-compute[71308]:     </memballoon>
Apr 14 18:52:15 user nova-compute[71308]:   </devices>
Apr 14 18:52:15 user nova-compute[71308]: </domain>
Apr 14 18:52:15 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:52:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Instance destroyed successfully.
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No VIF found with MAC fa:16:3e:2c:ac:1c, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:15 user nova-compute[71308]: INFO nova.compute.manager [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Detaching volume ced25197-205e-4821-82f2-1f37e41f5993
Apr 14 18:52:15 user nova-compute[71308]: INFO nova.virt.block_device [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attempting to driver detach volume ced25197-205e-4821-82f2-1f37e41f5993 from mountpoint /dev/vdb
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Attempting to detach device vdb from instance aa09363f-435d-4fa8-9f11-db0c3f4e08be from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:52:15 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:52:15 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:52:15 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:52:15 user nova-compute[71308]:   <serial>ced25197-205e-4821-82f2-1f37e41f5993</serial>
Apr 14 18:52:15 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 18:52:15 user nova-compute[71308]: </disk>
Apr 14 18:52:15 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:52:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully detached device vdb from instance aa09363f-435d-4fa8-9f11-db0c3f4e08be from the persistent domain config.
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa09363f-435d-4fa8-9f11-db0c3f4e08be from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:52:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:52:15 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:52:15 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:52:15 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:52:15 user nova-compute[71308]:   <serial>ced25197-205e-4821-82f2-1f37e41f5993</serial>
Apr 14 18:52:15 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 18:52:15 user nova-compute[71308]: </disk>
Apr 14 18:52:15 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498336.1539466, aa09363f-435d-4fa8-9f11-db0c3f4e08be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:52:16 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully detached device vdb from instance aa09363f-435d-4fa8-9f11-db0c3f4e08be from the live domain config.
Apr 14 18:52:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qBYpCkVj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:52:16 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.043s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64069b1-fbc3-48b1-bfa1-19444d7ce14f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:52:16 user nova-compute[71308]: No targets found.
Apr 14 18:52:16 user nova-compute[71308]: iSNS:
Apr 14 18:52:16 user nova-compute[71308]: No targets found.
Apr 14 18:52:16 user nova-compute[71308]: STATIC:
Apr 14 18:52:16 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71
Apr 14 18:52:16 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:16 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:16 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd
Apr 14 18:52:16 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:16 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:16 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993
Apr 14 18:52:16 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:16 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:16 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:52:16 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:16 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:16 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90
Apr 14 18:52:16 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:16 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:16 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490
Apr 14 18:52:16 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:16 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:16 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:52:16 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:16 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:16 user nova-compute[71308]: FIRMWARE:
Apr 14 18:52:16 user nova-compute[71308]: No targets found.
Apr 14 18:52:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:52:16 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:52:16 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e20461-f27f-4615-a07b-d182953ce06f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a35bd29-719a-4b36-893e-6b6132e4f85a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22542db370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[29389806-355a-4222-aff5-b4f9c874f85e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81f4415-2b5e-4839-945d-9b521da887b8]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[392db2eb-aeaa-482f-9cd3-b2a0e21aabcd]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecfbb02-6833-4dff-bc4c-1d8d571200da]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7e22f-34a1-4436-b6f4-eaab00152863]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef8cd29-c4e1-4219-aaae-23ee4db0c6b4]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260]
Apr 14 18:52:16 user nova-compute[71308]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993, portal: 172.16.0.220,3260] successful.
Apr 14 18:52:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] No waiting events found dispatching network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:16 user nova-compute[71308]: WARNING nova.compute.manager [req-94a99047-556d-451e-8aac-cd86efeab7c7 req-bc32cd10-105b-405b-8bf7-bbdd78a1b99b service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received unexpected event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance with vm_state active and task_state rescuing.
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced25197-205e-4821-82f2-1f37e41f5993 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[903ae6fc-079a-4cc5-a990-cc81cb545e6e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== disconnect_volume: return (413ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'flavor' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ed6cc23c-b1ea-4502-92b6-e83549d68c7c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.237s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:17 user nova-compute[71308]: INFO nova.compute.manager [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Terminating instance
Apr 14 18:52:17 user nova-compute[71308]: DEBUG nova.compute.manager [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-unplugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] No waiting events found dispatching network-vif-unplugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-0040e419-ab7f-4817-a415-0269c4a8b499 req-621330ee-0139-4429-b2fb-e275fd8515e4 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-unplugged-324b6810-d265-48bc-a2a9-ff7d4759a910 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:52:18 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Instance destroyed successfully.
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.objects.instance [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'resources' on Instance uuid 656b9f90-ce93-42cd-aa1b-3ff868162aae {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:47:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1753205108',display_name='tempest-TestMinimumBasicScenario-server-1753205108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1753205108',id=11,image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfCIaR3De/nNGfooewBKCs9Yqqif5k/8sNuCO7uN+hT9gFX4X7nnxenq2rxaGh4ksI9KaiGl0rKmMnWTxru18ybbLxqXOX8NwZxXuMtVOfaCykoVao1yh+Ul0yBt13edA==',key_name='tempest-TestMinimumBasicScenario-299923261',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e6b4e98cf9e4f96b79c3288dfe0da89',ramdisk_id='',reservation_id='r-6cmj1cxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9c46cc77-fd07-48b5-b135-2c845b3f989e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1257841115',owner_user_name='tempest-TestMinimumBasicScenario-1257841115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:49:42Z,user_data=None,user_id='67e1d31c2d9048699758779dedf7d3ac',uuid=656b9f90-ce93-42cd-aa1b-3ff868162aae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converting VIF {"id": "324b6810-d265-48bc-a2a9-ff7d4759a910", "address": "fa:16:3e:75:42:3b", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap324b6810-d2", "ovs_interfaceid": "324b6810-d265-48bc-a2a9-ff7d4759a910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG os_vif [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap324b6810-d2, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:18 user nova-compute[71308]: INFO os_vif [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:42:3b,bridge_name='br-int',has_traffic_filtering=True,id=324b6810-d265-48bc-a2a9-ff7d4759a910,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap324b6810-d2')
Apr 14 18:52:18 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Deleting instance files /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae_del
Apr 14 18:52:18 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Deletion of /opt/stack/data/nova/instances/656b9f90-ce93-42cd-aa1b-3ff868162aae_del complete
Apr 14 18:52:18 user nova-compute[71308]: INFO nova.compute.manager [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] No waiting events found dispatching network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:18 user nova-compute[71308]: WARNING nova.compute.manager [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received unexpected event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance with vm_state active and task_state rescuing.
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] No waiting events found dispatching network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:18 user nova-compute[71308]: WARNING nova.compute.manager [req-cab0ab17-6d46-450a-b2ab-e35bc7e3eac4 req-875d7444-f009-4b90-9a39-cc6d57a7c5a4 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received unexpected event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance with vm_state active and task_state rescuing.
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:19 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Took 0.70 seconds to deallocate network for instance.
Apr 14 18:52:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for cf640f3e-3d77-46ee-8a11-e0bdc870ff97 due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498339.4564676, cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:19 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] VM Resumed (Lifecycle Event)
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b2485db2-c70b-4b76-905d-c2c869007a81 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:52:19 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498339.4606485, cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:19 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] VM Started (Lifecycle Event)
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:52:19 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:52:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:19 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Deleted allocations for instance 656b9f90-ce93-42cd-aa1b-3ff868162aae
Apr 14 18:52:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f515f0f-3b5a-499e-8048-40628de85ae5 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.216s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] Acquiring lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] Lock "656b9f90-ce93-42cd-aa1b-3ff868162aae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] No waiting events found dispatching network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:20 user nova-compute[71308]: WARNING nova.compute.manager [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received unexpected event network-vif-plugged-324b6810-d265-48bc-a2a9-ff7d4759a910 for instance with vm_state deleted and task_state None.
Apr 14 18:52:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-c367b92d-f342-4170-9d4d-24d494878b78 req-1e4cdd86-2f75-4eba-b0a1-aa765323b309 service nova] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Received event network-vif-deleted-324b6810-d265-48bc-a2a9-ff7d4759a910 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:24 user nova-compute[71308]: INFO nova.compute.manager [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Terminating instance
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received event network-vif-unplugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] No waiting events found dispatching network-vif-unplugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-5a1995b3-c0e6-4b4c-be93-329d788d798c req-3eedef36-ff29-4e92-b98d-708b2db19b0d service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received event network-vif-unplugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:52:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Instance destroyed successfully.
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.objects.instance [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lazy-loading 'resources' on Instance uuid 817f112c-d806-4800-9e4a-a3892c54bee1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-875405056',display_name='tempest-VolumesAdminNegativeTest-server-875405056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-875405056',id=6,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZS7ySskesG5sOsdo/78qFpKWUvBoA4ziFwr5nR9D/I0C4AJuScxjt9mGbYfOP2ny0gRhvcSMfmUYwkaf98qvnWLlephh7/+MOryQ3b4Xp2gDHa/s4GPuvFDf4u9butPA==',key_name='tempest-keypair-397111654',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d22a362d9cb946a99c203366f88baafb',ramdisk_id='',reservation_id='r-nuiolm80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-714849235',owner_user_name='tempest-VolumesAdminNegativeTest-714849235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:46:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f78850ecd8042dbac5f24113b9df70e',uuid=817f112c-d806-4800-9e4a-a3892c54bee1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converting VIF {"id": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "address": "fa:16:3e:12:88:ee", "network": {"id": "054bef1d-1792-4d11-8f1a-974e696a2a77", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-76527804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d22a362d9cb946a99c203366f88baafb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a744ab3-b5", "ovs_interfaceid": "4a744ab3-b516-4349-adfd-98d2ce4332d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:88:ee,bridge_name='br-int',has_traffic_filtering=True,id=4a744ab3-b516-4349-adfd-98d2ce4332d2,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a744ab3-b5') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG os_vif [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:88:ee,bridge_name='br-int',has_traffic_filtering=True,id=4a744ab3-b516-4349-adfd-98d2ce4332d2,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a744ab3-b5') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a744ab3-b5, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:52:24 user nova-compute[71308]: INFO os_vif [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:88:ee,bridge_name='br-int',has_traffic_filtering=True,id=4a744ab3-b516-4349-adfd-98d2ce4332d2,network=Network(054bef1d-1792-4d11-8f1a-974e696a2a77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a744ab3-b5')
Apr 14 18:52:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Deleting instance files /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1_del
Apr 14 18:52:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Deletion of /opt/stack/data/nova/instances/817f112c-d806-4800-9e4a-a3892c54bee1_del complete
Apr 14 18:52:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:24 user nova-compute[71308]: INFO nova.compute.manager [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 18:52:24 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:52:24 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:52:25 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:26 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Took 1.09 seconds to deallocate network for instance.
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received event network-vif-plugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] Acquiring lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] Lock "817f112c-d806-4800-9e4a-a3892c54bee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] No waiting events found dispatching network-vif-plugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:26 user nova-compute[71308]: WARNING nova.compute.manager [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received unexpected event network-vif-plugged-4a744ab3-b516-4349-adfd-98d2ce4332d2 for instance with vm_state deleted and task_state None.
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-d712ea4d-0e3e-4d08-a4e4-fe17fb1a452e req-3265e26d-e87a-49f8-941f-ecc99ba4e0be service nova] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Received event network-vif-deleted-4a744ab3-b516-4349-adfd-98d2ce4332d2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:26 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Deleted allocations for instance 817f112c-d806-4800-9e4a-a3892c54bee1
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8ce999-7f4b-43f8-828b-ebc220da72de tempest-VolumesAdminNegativeTest-714849235 tempest-VolumesAdminNegativeTest-714849235-project-member] Lock "817f112c-d806-4800-9e4a-a3892c54bee1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.550s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid dc260db7-ffd6-4b7a-8b70-b4070478faab {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 1285eca2-575b-4550-a424-605fb186b510 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "1d305ab4-1813-4728-a01c-287e521a05ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "1285eca2-575b-4550-a424-605fb186b510" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "1d305ab4-1813-4728-a01c-287e521a05ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "1285eca2-575b-4550-a424-605fb186b510" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-changed-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing instance network info cache due to event network-changed-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:52:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] Acquiring lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:52:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] Acquired lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:52:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Refreshing network info cache for port 7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updated VIF entry in instance network info cache for port 7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [{"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9ca45125-d1e5-46a2-abd3-34c9ebc69059 req-6e5a2e3e-e8d8-4edd-872f-89cea4481a44 service nova] Releasing lock "refresh_cache-dc260db7-ffd6-4b7a-8b70-b4070478faab" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:29 user nova-compute[71308]: INFO nova.compute.manager [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Terminating instance
Apr 14 18:52:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-unplugged-f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-d121ad84-53bb-40f9-aaa3-3bf69b3d010e req-0d0f94f2-e683-485f-909f-b95755718779 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-f4fbff28-9aec-444f-aef4-a67e882a9255 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-unplugged-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-9c8dcd6d-8be3-4270-8d5d-1a6e1abdae16 req-05f2dbdf-ddee-4a46-b3c5-4e089b12924b service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-6dc22897-5349-4914-8ab8-eafee74a17dc for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-unplugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:30 user nova-compute[71308]: WARNING nova.compute.manager [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 for instance with vm_state active and task_state deleting.
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-unplugged-2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-960df98e-4254-47fc-808d-67b3849e3fbf req-9b6950b2-95d1-4463-8ace-b87e75a0b965 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-2af029d9-055b-406b-a82d-a88d8b51c4fa for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Instance destroyed successfully.
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.objects.instance [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lazy-loading 'resources' on Instance uuid dc260db7-ffd6-4b7a-8b70-b4070478faab {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8,network=Network(6508b35e-2e3c-4d6a-8952-0176e7be3891),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5b6c2-fb') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8,network=Network(6508b35e-2e3c-4d6a-8952-0176e7be3891),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5b6c2-fb') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ff5b6c2-fb, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: INFO os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:9a:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8,network=Network(6508b35e-2e3c-4d6a-8952-0176e7be3891),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5b6c2-fb')
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:77:3c,bridge_name='br-int',has_traffic_filtering=True,id=2af029d9-055b-406b-a82d-a88d8b51c4fa,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2af029d9-05') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:77:3c,bridge_name='br-int',has_traffic_filtering=True,id=2af029d9-055b-406b-a82d-a88d8b51c4fa,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2af029d9-05') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2af029d9-05, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: INFO os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:77:3c,bridge_name='br-int',has_traffic_filtering=True,id=2af029d9-055b-406b-a82d-a88d8b51c4fa,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2af029d9-05')
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4fbff28-9aec-444f-aef4-a67e882a9255,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4fbff28-9a') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4fbff28-9aec-444f-aef4-a67e882a9255,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4fbff28-9a') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4fbff28-9a, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: INFO os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:5d:d6,bridge_name='br-int',has_traffic_filtering=True,id=f4fbff28-9aec-444f-aef4-a67e882a9255,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf4fbff28-9a')
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=6dc22897-5349-4914-8ab8-eafee74a17dc,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc22897-53') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=6dc22897-5349-4914-8ab8-eafee74a17dc,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc22897-53') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6dc22897-53, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: INFO os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:56:8a,bridge_name='br-int',has_traffic_filtering=True,id=6dc22897-5349-4914-8ab8-eafee74a17dc,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc22897-53')
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "6b1efba7-12bf-4333-a320-c76218ba1b09", "address": "fa:16:3e:40:b4:b3", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b1efba7-12", "ovs_interfaceid": "6b1efba7-12bf-4333-a320-c76218ba1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:b4:b3,bridge_name='br-int',has_traffic_filtering=True,id=6b1efba7-12bf-4333-a320-c76218ba1b09,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1efba7-12') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b4:b3,bridge_name='br-int',has_traffic_filtering=True,id=6b1efba7-12bf-4333-a320-c76218ba1b09,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1efba7-12') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b1efba7-12, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: INFO os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:b4:b3,bridge_name='br-int',has_traffic_filtering=True,id=6b1efba7-12bf-4333-a320-c76218ba1b09,network=Network(af7faac4-eb43-4442-bc1b-5846ff21f36f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b1efba7-12')
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:9f:83,bridge_name='br-int',has_traffic_filtering=True,id=3ad5bb9e-1641-4726-887d-031aeadf4c60,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad5bb9e-16') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:9f:83,bridge_name='br-int',has_traffic_filtering=True,id=3ad5bb9e-1641-4726-887d-031aeadf4c60,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad5bb9e-16') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ad5bb9e-16, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: INFO os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:9f:83,bridge_name='br-int',has_traffic_filtering=True,id=3ad5bb9e-1641-4726-887d-031aeadf4c60,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ad5bb9e-16')
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T18:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-750671987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-750671987',id=18,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC137Xf3AnF1rNtIhwlNVYT522UpBbMSfFdG6x9R8uAHDX1y4mjdFVLuE4+V7JiMD4jkchT1K4wNrq2r/rMuPGS+e3iEX6He8rTuPweC7QQlcmkQV4D2K0Puqu4A57IOrA==',key_name='tempest-keypair-1346818342',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c49bffa4d8e4f92a54ad17a5f5db634',ramdisk_id='',reservation_id='r-m1zamz5o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-632155347',owner_user_name='tempest-TaggedBootDevicesTest_v242-632155347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ee19795311144e69dd00db0403cb8b1',uuid=dc260db7-ffd6-4b7a-8b70-b4070478faab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converting VIF {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=bb067fd8-e349-48fe-8450-b2308b4ccdab,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb067fd8-e3') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=bb067fd8-e349-48fe-8450-b2308b4ccdab,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb067fd8-e3') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb067fd8-e3, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:52:31 user nova-compute[71308]: INFO os_vif [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b6:4b,bridge_name='br-int',has_traffic_filtering=True,id=bb067fd8-e349-48fe-8450-b2308b4ccdab,network=Network(958931d7-a1a9-4a23-b950-7180df8d7edc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb067fd8-e3')
Apr 14 18:52:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjLWOhiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:52:31 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d507ba-0c5a-4898-8e9a-25782eaf9d19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:52:31 user nova-compute[71308]: No targets found.
Apr 14 18:52:31 user nova-compute[71308]: iSNS:
Apr 14 18:52:31 user nova-compute[71308]: No targets found.
Apr 14 18:52:31 user nova-compute[71308]: STATIC:
Apr 14 18:52:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71
Apr 14 18:52:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd
Apr 14 18:52:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:52:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90
Apr 14 18:52:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490
Apr 14 18:52:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:31 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:52:31 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:31 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:31 user nova-compute[71308]: FIRMWARE:
Apr 14 18:52:31 user nova-compute[71308]: No targets found.
Apr 14 18:52:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:52:31 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:52:31 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[461dbe04-877f-4e65-9716-54d03d680d10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7d28e3-7dc3-471b-8f1e-c602aac44446]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22542da680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd'): ({'sdg'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Removing single pathed devices sdg {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1b4498-1d25-42cf-8ad2-787fb968add4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29b35d0-c50d-4804-9c32-dbf691d3b7cb]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Flushing IO for device /dev/sdg {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c64813-d379-4c7e-b3b6-9b618275ed21]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c825e90-f801-4b0b-8b09-1db58ce40580]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1a0631-de4d-4617-bd7b-838b17861715]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f45e23f-fc8f-4f3f-8a40-03f65a50e0ea]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd, portal: 172.16.0.220,3260]
Apr 14 18:52:32 user nova-compute[71308]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd, portal: 172.16.0.220,3260] successful.
Apr 14 18:52:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-f4fbff28-9aec-444f-aef4-a67e882a9255 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:32 user nova-compute[71308]: WARNING nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-f4fbff28-9aec-444f-aef4-a67e882a9255 for instance with vm_state active and task_state deleting.
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-unplugged-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-6b1efba7-12bf-4333-a320-c76218ba1b09 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:32 user nova-compute[71308]: WARNING nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-6b1efba7-12bf-4333-a320-c76218ba1b09 for instance with vm_state active and task_state deleting.
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-unplugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:32 user nova-compute[71308]: WARNING nova.compute.manager [req-ed523c83-94b3-4e82-bb5f-7ae6ad6fb751 req-e7f1a36e-e127-4504-8e28-12fef832b10a service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-3ad5bb9e-1641-4726-887d-031aeadf4c60 for instance with vm_state active and task_state deleting.
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68e8b1ad-3eb6-4174-b56d-0a8b2d1754cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f07264-8d99-4bb6-a98e-54a67ffd4152]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] <== disconnect_volume: return (333ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WfjTemYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:52:32 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfbbf4b-a63c-4a7c-a4a2-04ef98313459]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:52:32 user nova-compute[71308]: No targets found.
Apr 14 18:52:32 user nova-compute[71308]: iSNS:
Apr 14 18:52:32 user nova-compute[71308]: No targets found.
Apr 14 18:52:32 user nova-compute[71308]: STATIC:
Apr 14 18:52:32 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71
Apr 14 18:52:32 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:32 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:32 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:52:32 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:32 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:32 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90
Apr 14 18:52:32 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:32 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:32 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490
Apr 14 18:52:32 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:32 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:32 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:52:32 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:32 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:32 user nova-compute[71308]: FIRMWARE:
Apr 14 18:52:32 user nova-compute[71308]: No targets found.
Apr 14 18:52:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:52:32 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:52:32 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb515544-bad5-4ed0-be5c-91eb139d666e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d763203-7d5a-427c-9849-c91b967bf72e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f226c2e27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490'): ({'sdh'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Removing single pathed devices sdh {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5225e81-07a9-40b6-8cd0-28c043664bc2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7cc27b-ac77-4e55-b551-c8de8f752c29]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Flushing IO for device /dev/sdh {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[221aa7b3-b68b-49c1-af60-1650897f0ddc]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3a4dad-f9d9-4765-8f37-033829df26e6]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] SCSI volumes sdh have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cb81f3-7385-461c-b17a-dccf406e8ba3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:32 user nova-compute[71308]: WARNING nova.compute.manager [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-6dc22897-5349-4914-8ab8-eafee74a17dc for instance with vm_state active and task_state deleting.
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-unplugged-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-unplugged-bb067fd8-e349-48fe-8450-b2308b4ccdab for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:32 user nova-compute[71308]: WARNING nova.compute.manager [req-7182fb81-22da-4318-a4f8-0676743597f3 req-cbb75a1a-3fcd-4f38-818b-5fab1cd5ffbd service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-bb067fd8-e349-48fe-8450-b2308b4ccdab for instance with vm_state active and task_state deleting.
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26290eb-3304-4c5c-bab0-ecf7bf2767b4]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490, portal: 172.16.0.220,3260]
Apr 14 18:52:32 user nova-compute[71308]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490, portal: 172.16.0.220,3260] successful.
Apr 14 18:52:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba800019-a4b5-415c-8525-6059d9336490 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[905af949-3108-4fe6-b3f3-590c4fb4e81c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] <== disconnect_volume: return (348ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bKfXeQZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:52:32 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4808af0-cda8-44c7-b2be-da968e71a65b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:52:32 user nova-compute[71308]: No targets found.
Apr 14 18:52:32 user nova-compute[71308]: iSNS:
Apr 14 18:52:32 user nova-compute[71308]: No targets found.
Apr 14 18:52:32 user nova-compute[71308]: STATIC:
Apr 14 18:52:32 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71
Apr 14 18:52:32 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:32 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:32 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:52:32 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:32 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:32 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90
Apr 14 18:52:32 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:32 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:32 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:52:32 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:32 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:32 user nova-compute[71308]: FIRMWARE:
Apr 14 18:52:32 user nova-compute[71308]: No targets found.
Apr 14 18:52:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:52:32 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:52:32 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5763085-91a9-4fcd-aa9c-46b2be301057]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-plugged-2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] Acquiring lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] No waiting events found dispatching network-vif-plugged-2af029d9-055b-406b-a82d-a88d8b51c4fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:32 user nova-compute[71308]: WARNING nova.compute.manager [req-327e7933-ab2c-4b68-9b10-661f5aa51a76 req-b6610bc7-5ef0-4074-a1f3-13c9330ae3c0 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received unexpected event network-vif-plugged-2af029d9-055b-406b-a82d-a88d8b51c4fa for instance with vm_state active and task_state deleting.
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e02be3-a08e-4b31-b598-f87d3d539b72]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22540faef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90'): ({'sdi'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Removing single pathed devices sdi {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5641d389-4411-42ae-9f79-36cbb7a21f71]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c648146d-ed29-47a6-8020-14f838601fe4]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Flushing IO for device /dev/sdi {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab273867-08d0-4053-a89b-2cfc5b430fff]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[872b57a9-bb2d-41eb-b2eb-9524a6ee5868]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] SCSI volumes sdi have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6887fbec-886d-419b-97c8-437c12b5a7e1]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f00c69-3ec0-4f13-8d0f-a2da965c46a7]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90, portal: 172.16.0.220,3260]
Apr 14 18:52:32 user nova-compute[71308]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90, portal: 172.16.0.220,3260] successful.
Apr 14 18:52:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1039149-f70d-4abd-a8fa-48767f099f90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd05724-1dfe-4b34-adc5-a7395b3d4273]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] <== disconnect_volume: return (345ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:52:32 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Deleting instance files /opt/stack/data/nova/instances/dc260db7-ffd6-4b7a-8b70-b4070478faab_del
Apr 14 18:52:32 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Deletion of /opt/stack/data/nova/instances/dc260db7-ffd6-4b7a-8b70-b4070478faab_del complete
Apr 14 18:52:32 user nova-compute[71308]: INFO nova.compute.manager [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Took 3.48 seconds to destroy the instance on the hypervisor.
Apr 14 18:52:32 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:52:32 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:52:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:33 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498338.5136497, 656b9f90-ce93-42cd-aa1b-3ff868162aae => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:33 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] VM Stopped (Lifecycle Event)
Apr 14 18:52:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ea5d832a-c84f-4e26-9fc7-c63dc64371c6 None None] [instance: 656b9f90-ce93-42cd-aa1b-3ff868162aae] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:34 user nova-compute[71308]: INFO nova.compute.manager [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Detaching volume e73ec3ca-6e83-4144-8fe7-315e5ee57a71
Apr 14 18:52:34 user nova-compute[71308]: INFO nova.virt.block_device [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Attempting to driver detach volume e73ec3ca-6e83-4144-8fe7-315e5ee57a71 from mountpoint /dev/vdb
Apr 14 18:52:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Attempting to detach device vdb from instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:52:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:52:34 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:52:34 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:52:34 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:52:34 user nova-compute[71308]:   <serial>e73ec3ca-6e83-4144-8fe7-315e5ee57a71</serial>
Apr 14 18:52:34 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:52:34 user nova-compute[71308]: </disk>
Apr 14 18:52:34 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:52:34 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Successfully detached device vdb from instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c from the persistent domain config.
Apr 14 18:52:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:52:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:52:34 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:52:34 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 18:52:34 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:52:34 user nova-compute[71308]:   <serial>e73ec3ca-6e83-4144-8fe7-315e5ee57a71</serial>
Apr 14 18:52:34 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:52:34 user nova-compute[71308]: </disk>
Apr 14 18:52:34 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:52:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-deleted-6b1efba7-12bf-4333-a320-c76218ba1b09 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:34 user nova-compute[71308]: INFO nova.compute.manager [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Neutron deleted interface 6b1efba7-12bf-4333-a320-c76218ba1b09; detaching it from the instance and deleting it from the info cache
Apr 14 18:52:34 user nova-compute[71308]: DEBUG nova.network.neutron [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [{"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "address": "fa:16:3e:6d:9f:83", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ad5bb9e-16", "ovs_interfaceid": "3ad5bb9e-1641-4726-887d-031aeadf4c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-d5cf9f32-0178-4f13-a8f8-cd30bb2e42fa req-24529be7-74d2-466e-82f2-4bdc746324d6 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Detach interface failed, port_id=6b1efba7-12bf-4333-a320-c76218ba1b09, reason: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:52:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498354.9920788, 8e55c721-9fad-4478-9e74-e87d0c95bc3c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:52:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:52:34 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Successfully detached device vdb from instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c from the live domain config.
Apr 14 18:52:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpYfstCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:52:35 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b6b6e2-f881-4872-8997-17b90ab4ad4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:52:35 user nova-compute[71308]: No targets found.
Apr 14 18:52:35 user nova-compute[71308]: iSNS:
Apr 14 18:52:35 user nova-compute[71308]: No targets found.
Apr 14 18:52:35 user nova-compute[71308]: STATIC:
Apr 14 18:52:35 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71
Apr 14 18:52:35 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:35 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:35 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:52:35 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:35 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:35 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:52:35 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:52:35 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:52:35 user nova-compute[71308]: FIRMWARE:
Apr 14 18:52:35 user nova-compute[71308]: No targets found.
Apr 14 18:52:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:52:35 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:52:35 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9994f22a-a6e3-490e-a0d5-4159a028d077]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[697de905-d2bc-488e-9e12-869e49b60289]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:35 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:35 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:35 user nova-compute[71308]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 (non-flash)
Apr 14 18:52:35 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aaa7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71'): ({'sdf'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Removing single pathed devices sdf {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2dd706-b5af-480a-b3d3-7687618bb6b7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d92a8e-5a15-41d9-a273-354f69fe55ea]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Flushing IO for device /dev/sdf {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[50409ada-0aeb-4a9d-b0d2-8f94c84fb552]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.064s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b7f114-7886-4660-9f8d-c3ebc1255578]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0897d6-fa0e-4741-a2da-9ca326d9906d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5223c73-f5a7-40bc-b6d5-7d277c33f06d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71, portal: 172.16.0.220,3260]
Apr 14 18:52:35 user nova-compute[71308]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71, portal: 172.16.0.220,3260] successful.
Apr 14 18:52:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73ec3ca-6e83-4144-8fe7-315e5ee57a71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[97df4c04-b2ee-4c4c-bd2f-98cfe28bf29c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] <== disconnect_volume: return (347ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:52:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:52:36 user nova-compute[71308]: DEBUG nova.objects.instance [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'flavor' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6afc6094-57de-4f48-8480-c4d3f42f8aa8 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.925s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:36 user nova-compute[71308]: DEBUG nova.compute.manager [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-deleted-3ad5bb9e-1641-4726-887d-031aeadf4c60 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:36 user nova-compute[71308]: INFO nova.compute.manager [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Neutron deleted interface 3ad5bb9e-1641-4726-887d-031aeadf4c60; detaching it from the instance and deleting it from the info cache
Apr 14 18:52:36 user nova-compute[71308]: DEBUG nova.network.neutron [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [{"id": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "address": "fa:16:3e:9b:9a:f6", "network": {"id": "6508b35e-2e3c-4d6a-8952-0176e7be3891", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1089454258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5b6c2-fb", "ovs_interfaceid": "7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Detach interface failed, port_id=3ad5bb9e-1641-4726-887d-031aeadf4c60, reason: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:52:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-deleted-7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:37 user nova-compute[71308]: INFO nova.compute.manager [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Neutron deleted interface 7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8; detaching it from the instance and deleting it from the info cache
Apr 14 18:52:37 user nova-compute[71308]: DEBUG nova.network.neutron [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [{"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "address": "fa:16:3e:5c:b6:4b", "network": {"id": "958931d7-a1a9-4a23-b950-7180df8d7edc", "bridge": "br-int", "label": "tempest-device-tagging-net2-1085139466", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb067fd8-e3", "ovs_interfaceid": "bb067fd8-e349-48fe-8450-b2308b4ccdab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Detach interface failed, port_id=7ff5b6c2-fb1a-4c77-a77c-1a57920ff0a8, reason: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:52:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-deleted-bb067fd8-e349-48fe-8450-b2308b4ccdab {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:37 user nova-compute[71308]: INFO nova.compute.manager [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Neutron deleted interface bb067fd8-e349-48fe-8450-b2308b4ccdab; detaching it from the instance and deleting it from the info cache
Apr 14 18:52:37 user nova-compute[71308]: DEBUG nova.network.neutron [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [{"id": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "address": "fa:16:3e:c2:77:3c", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2af029d9-05", "ovs_interfaceid": "2af029d9-055b-406b-a82d-a88d8b51c4fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f4fbff28-9aec-444f-aef4-a67e882a9255", "address": "fa:16:3e:cf:5d:d6", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4fbff28-9a", "ovs_interfaceid": "f4fbff28-9aec-444f-aef4-a67e882a9255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6dc22897-5349-4914-8ab8-eafee74a17dc", "address": "fa:16:3e:30:56:8a", "network": {"id": "af7faac4-eb43-4442-bc1b-5846ff21f36f", "bridge": "br-int", "label": "tempest-device-tagging-net1-609487914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5c49bffa4d8e4f92a54ad17a5f5db634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc22897-53", "ovs_interfaceid": "6dc22897-5349-4914-8ab8-eafee74a17dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-acd0eead-e570-454e-8b38-b2d9cf440bbc req-450b343f-3bd8-4ea2-ba99-b96a2a23d445 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Detach interface failed, port_id=bb067fd8-e349-48fe-8450-b2308b4ccdab, reason: Instance dc260db7-ffd6-4b7a-8b70-b4070478faab could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:52:37 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:37 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Took 4.23 seconds to deallocate network for instance.
Apr 14 18:52:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:39 user nova-compute[71308]: DEBUG nova.compute.manager [req-e56696ce-74df-4f08-8f85-89b608a9ac20 req-4af9e0f0-b098-4661-bfd1-402f8537b4f5 service nova] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Received event network-vif-deleted-6dc22897-5349-4914-8ab8-eafee74a17dc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:39 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498344.7938988, 817f112c-d806-4800-9e4a-a3892c54bee1 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:39 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] VM Stopped (Lifecycle Event)
Apr 14 18:52:39 user nova-compute[71308]: DEBUG nova.compute.manager [None req-eaeeda4f-b1f6-4756-8b0c-a21c1af5c8a6 None None] [instance: 817f112c-d806-4800-9e4a-a3892c54bee1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:40 user nova-compute[71308]: INFO nova.compute.manager [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Took 2.95 seconds to detach 3 volumes for instance.
Apr 14 18:52:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:40 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:52:40 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:52:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:40 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Deleted allocations for instance dc260db7-ffd6-4b7a-8b70-b4070478faab
Apr 14 18:52:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bb126131-2a48-48d6-9b7e-8fc9d33c55a2 tempest-TaggedBootDevicesTest_v242-632155347 tempest-TaggedBootDevicesTest_v242-632155347-project-member] Lock "dc260db7-ffd6-4b7a-8b70-b4070478faab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.340s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:43 user nova-compute[71308]: INFO nova.compute.manager [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Unrescuing
Apr 14 18:52:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:52:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquired lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:52:43 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updating instance_info_cache with network_info: [{"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Releasing lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'flavor' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'flavor' on Instance uuid 1285eca2-575b-4550-a424-605fb186b510 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Ignoring supplied device name: /dev/vdb
Apr 14 18:52:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-unplugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-unplugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:44 user nova-compute[71308]: WARNING nova.compute.manager [req-1ec045b0-1a84-4fcc-9f2a-df274c1258c5 req-62f5a154-9409-4eaa-bef9-fa82b6612e1a service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-unplugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:44 user nova-compute[71308]: INFO nova.compute.manager [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Attaching volume 1966d299-f72f-45d4-91de-eff266b7e44d to /dev/vdb
Apr 14 18:52:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG os_brick.utils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[07615d35-70d6-4297-82e0-bce717d29b7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be993f-abb1-4d82-ab0c-3c1a664d1cca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac37c84-5ae5-4a16-a264-ce21f4009723]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb5eeaa-21c8-45c1-8b57-2e8df070b5f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:52:44 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:52:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7a263c-0671-454a-b491-7b200ca5c95a]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG os_brick.utils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:52:44 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Updating existing volume attachment record: c91e95f9-9b30-4e16-9bc8-4c964d441970 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:52:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Instance destroyed successfully.
Apr 14 18:52:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:52:45 user nova-compute[71308]: INFO nova.compute.claims [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Claim successful on node user
Apr 14 18:52:45 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:52:45 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:52:45 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:52:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.policy [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:52:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Creating image(s)
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "/opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "/opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "/opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:46 user nova-compute[71308]: WARNING nova.compute.manager [req-d1bd2226-4f11-4fab-976b-fa512f66eed1 req-f2cff6e0-301d-405a-aa64-910a71e3ee9a service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:52:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk 1073741824" returned: 0 in 0.058s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498351.5575755, dc260db7-ffd6-4b7a-8b70-b4070478faab => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:46 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] VM Stopped (Lifecycle Event)
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-abd1ee86-3d08-4103-bd9b-6f741fb7b5bf None None] [instance: dc260db7-ffd6-4b7a-8b70-b4070478faab] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Cannot resize image /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'migration_context' on Instance uuid 61944d61-738b-42a7-a95d-8caa6fa29a38 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Ensure instance console log exists: /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Successfully created port: 62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:52:47 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Successfully updated port: 62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:52:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "refresh_cache-61944d61-738b-42a7-a95d-8caa6fa29a38" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:52:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquired lock "refresh_cache-61944d61-738b-42a7-a95d-8caa6fa29a38" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:52:47 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:52:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received event network-changed-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Refreshing instance network info cache due to event network-changed-62d648bd-cf77-401d-abcf-b4f95e339dc9. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:52:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] Acquiring lock "refresh_cache-61944d61-738b-42a7-a95d-8caa6fa29a38" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:52:47 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Updating instance_info_cache with network_info: [{"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Releasing lock "refresh_cache-61944d61-738b-42a7-a95d-8caa6fa29a38" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Instance network_info: |[{"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] Acquired lock "refresh_cache-61944d61-738b-42a7-a95d-8caa6fa29a38" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.network.neutron [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Refreshing network info cache for port 62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Start _get_guest_xml network_info=[{"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:52:48 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:52:48 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-392017485',display_name='tempest-AttachVolumeNegativeTest-server-392017485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-392017485',id=22,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBdTHH0H6VXNnMYimnSG4KckCVTwmifHZuurimvpTfWYb4mgJKyCtQIabvc1PZ8V26HhS8h70WozUX1N4eA51ipk4XibhZWDpmGlM6sre8QIwBcSpKz+aM7zxlomNBtFw==',key_name='tempest-keypair-1273846851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-ocyjbqwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=61944d61-738b-42a7-a95d-8caa6fa29a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:78:30,bridge_name='br-int',has_traffic_filtering=True,id=62d648bd-cf77-401d-abcf-b4f95e339dc9,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d648bd-cf') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'pci_devices' on Instance uuid 61944d61-738b-42a7-a95d-8caa6fa29a38 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:52:48 user nova-compute[71308]:   <uuid>61944d61-738b-42a7-a95d-8caa6fa29a38</uuid>
Apr 14 18:52:48 user nova-compute[71308]:   <name>instance-00000016</name>
Apr 14 18:52:48 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:52:48 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:52:48 user nova-compute[71308]:   <metadata>
Apr 14 18:52:48 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:52:48 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:52:48 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeNegativeTest-server-392017485</nova:name>
Apr 14 18:52:48 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:52:48</nova:creationTime>
Apr 14 18:52:48 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:52:48 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:52:48 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:52:48 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:52:48 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:52:48 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:52:48 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:52:48 user nova-compute[71308]:       <nova:owner>
Apr 14 18:52:48 user nova-compute[71308]:         <nova:user uuid="8d53edaffb8f4038abd366d7942c6bc7">tempest-AttachVolumeNegativeTest-1648028886-project-member</nova:user>
Apr 14 18:52:48 user nova-compute[71308]:         <nova:project uuid="e34cdebcd7154988a957deae140e8eab">tempest-AttachVolumeNegativeTest-1648028886</nova:project>
Apr 14 18:52:48 user nova-compute[71308]:       </nova:owner>
Apr 14 18:52:48 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:52:48 user nova-compute[71308]:       <nova:ports>
Apr 14 18:52:48 user nova-compute[71308]:         <nova:port uuid="62d648bd-cf77-401d-abcf-b4f95e339dc9">
Apr 14 18:52:48 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 18:52:48 user nova-compute[71308]:         </nova:port>
Apr 14 18:52:48 user nova-compute[71308]:       </nova:ports>
Apr 14 18:52:48 user nova-compute[71308]:     </nova:instance>
Apr 14 18:52:48 user nova-compute[71308]:   </metadata>
Apr 14 18:52:48 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:52:48 user nova-compute[71308]:     <system>
Apr 14 18:52:48 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:52:48 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:52:48 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:52:48 user nova-compute[71308]:       <entry name="serial">61944d61-738b-42a7-a95d-8caa6fa29a38</entry>
Apr 14 18:52:48 user nova-compute[71308]:       <entry name="uuid">61944d61-738b-42a7-a95d-8caa6fa29a38</entry>
Apr 14 18:52:48 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:52:48 user nova-compute[71308]:     </system>
Apr 14 18:52:48 user nova-compute[71308]:   </sysinfo>
Apr 14 18:52:48 user nova-compute[71308]:   <os>
Apr 14 18:52:48 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:52:48 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:52:48 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:52:48 user nova-compute[71308]:   </os>
Apr 14 18:52:48 user nova-compute[71308]:   <features>
Apr 14 18:52:48 user nova-compute[71308]:     <acpi/>
Apr 14 18:52:48 user nova-compute[71308]:     <apic/>
Apr 14 18:52:48 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:52:48 user nova-compute[71308]:   </features>
Apr 14 18:52:48 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:52:48 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:52:48 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:52:48 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:52:48 user nova-compute[71308]:   </clock>
Apr 14 18:52:48 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:52:48 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:52:48 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:52:48 user nova-compute[71308]:   </cpu>
Apr 14 18:52:48 user nova-compute[71308]:   <devices>
Apr 14 18:52:48 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:52:48 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:52:48 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk"/>
Apr 14 18:52:48 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:52:48 user nova-compute[71308]:     </disk>
Apr 14 18:52:48 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:52:48 user nova-compute[71308]:       <mac address="fa:16:3e:d7:78:30"/>
Apr 14 18:52:48 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:52:48 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:52:48 user nova-compute[71308]:       <target dev="tap62d648bd-cf"/>
Apr 14 18:52:48 user nova-compute[71308]:     </interface>
Apr 14 18:52:48 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:52:48 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/console.log" append="off"/>
Apr 14 18:52:48 user nova-compute[71308]:     </serial>
Apr 14 18:52:48 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:52:48 user nova-compute[71308]:     <video>
Apr 14 18:52:48 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:52:48 user nova-compute[71308]:     </video>
Apr 14 18:52:48 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:52:48 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:52:48 user nova-compute[71308]:     </rng>
Apr 14 18:52:48 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:52:48 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:52:48 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:52:48 user nova-compute[71308]:     </memballoon>
Apr 14 18:52:48 user nova-compute[71308]:   </devices>
Apr 14 18:52:48 user nova-compute[71308]: </domain>
Apr 14 18:52:48 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-392017485',display_name='tempest-AttachVolumeNegativeTest-server-392017485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-392017485',id=22,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBdTHH0H6VXNnMYimnSG4KckCVTwmifHZuurimvpTfWYb4mgJKyCtQIabvc1PZ8V26HhS8h70WozUX1N4eA51ipk4XibhZWDpmGlM6sre8QIwBcSpKz+aM7zxlomNBtFw==',key_name='tempest-keypair-1273846851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-ocyjbqwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:52:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=61944d61-738b-42a7-a95d-8caa6fa29a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:78:30,bridge_name='br-int',has_traffic_filtering=True,id=62d648bd-cf77-401d-abcf-b4f95e339dc9,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d648bd-cf') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG os_vif [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:78:30,bridge_name='br-int',has_traffic_filtering=True,id=62d648bd-cf77-401d-abcf-b4f95e339dc9,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d648bd-cf') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62d648bd-cf, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62d648bd-cf, col_values=(('external_ids', {'iface-id': '62d648bd-cf77-401d-abcf-b4f95e339dc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:78:30', 'vm-uuid': '61944d61-738b-42a7-a95d-8caa6fa29a38'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:48 user nova-compute[71308]: INFO os_vif [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:78:30,bridge_name='br-int',has_traffic_filtering=True,id=62d648bd-cf77-401d-abcf-b4f95e339dc9,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d648bd-cf')
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No VIF found with MAC fa:16:3e:d7:78:30, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:48 user nova-compute[71308]: WARNING nova.compute.manager [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:48 user nova-compute[71308]: WARNING nova.compute.manager [req-280b1a65-60e2-4218-8c95-0293f648a696 req-2e1922ef-b0d3-4d2f-bed7-9d6ef626a183 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.network.neutron [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Updated VIF entry in instance network info cache for port 62d648bd-cf77-401d-abcf-b4f95e339dc9. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.network.neutron [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Updating instance_info_cache with network_info: [{"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1c152661-3367-4692-9de9-831ffea3e531 req-37174a96-e128-4259-b77d-1c3f8f2cff52 service nova] Releasing lock "refresh_cache-61944d61-738b-42a7-a95d-8caa6fa29a38" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 23d14a51-41aa-4827-bd60-c605d9689bc8 due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498368.7079458, 23d14a51-41aa-4827-bd60-c605d9689bc8 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:48 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] VM Resumed (Lifecycle Event)
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e6a9a5fe-03db-4b37-be0d-a9bcddfcbc80 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:52:48 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498368.709625, 23d14a51-41aa-4827-bd60-c605d9689bc8 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:48 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] VM Started (Lifecycle Event)
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyEVxbvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:52:49 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:52:49 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:52:49 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cbe1a8-7aa9-4253-a65a-cb65bd4104cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:52:49 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4209bbe6-71d3-42d2-8cdc-7520f8ee4779]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d] added
Apr 14 18:52:49 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01d739e-4f4a-4c83-ae43-89a5903f42e3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33237e5-c935-49f9-9b90-b1d4b4b8b1a4]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyEVxbvd {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IyEVxbvd" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47530bb-88fe-4167-b22a-c64e524a2b5f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IyEVxbvd'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[566bcd53-339b-48bf-bd0a-fe9927976624]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc7631e-db21-4e04-aa5b-86da1e347153]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:49 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:49 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:49 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:49 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cd2e39-81dd-46dc-8726-c1ec86378229]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d, portal: 172.16.0.220,3260]
Apr 14 18:52:49 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d, portal: 172.16.0.220,3260] successful.
Apr 14 18:52:49 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0463247-2553-4106-87dc-72caacc9d383]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30a61e-79ca-4885-a34a-32b6031fae1d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:49 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:49 user nova-compute[71308]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d (non-flash)
Apr 14 18:52:49 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:52:49 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:52:49 user nova-compute[71308]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d (non-flash)
Apr 14 18:52:49 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[61176630-74d8-4a43-af64-c10f58061347]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:52:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyEVxbvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received event network-vif-plugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] No waiting events found dispatching network-vif-plugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:50 user nova-compute[71308]: WARNING nova.compute.manager [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received unexpected event network-vif-plugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance with vm_state building and task_state spawning.
Apr 14 18:52:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received event network-vif-plugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] No waiting events found dispatching network-vif-plugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:52:50 user nova-compute[71308]: WARNING nova.compute.manager [req-9f78f8da-d100-4629-a598-01a54fd2ee94 req-1f9df2a9-b896-4f03-a90b-70a57983e790 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received unexpected event network-vif-plugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance with vm_state building and task_state spawning.
Apr 14 18:52:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26363306665363831', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363306665363831', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'flavor' on Instance uuid 1285eca2-575b-4550-a424-605fb186b510 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:52:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:52:50 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:52:50 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:52:50 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:52:50 user nova-compute[71308]:   <serial>1966d299-f72f-45d4-91de-eff266b7e44d</serial>
Apr 14 18:52:50 user nova-compute[71308]: </disk>
Apr 14 18:52:50 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] No VIF found with MAC fa:16:3e:86:ec:d9, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2968231d-ff41-44d1-8d15-7102cfade450 tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.068s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498371.7946658, 61944d61-738b-42a7-a95d-8caa6fa29a38 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] VM Resumed (Lifecycle Event)
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:52:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Instance spawned successfully.
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:52:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498371.795688, 61944d61-738b-42a7-a95d-8caa6fa29a38 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:52:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] VM Started (Lifecycle Event)
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:52:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:52:51 user nova-compute[71308]: INFO nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Took 5.77 seconds to spawn the instance on the hypervisor.
Apr 14 18:52:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:52:51 user nova-compute[71308]: INFO nova.compute.manager [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Took 6.74 seconds to build instance.
Apr 14 18:52:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fcd0321f-3d99-4778-a492-ab20675bc3f7 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.875s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:52:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:52:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:00 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:53:00 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:53:01 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:53:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:53:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:53:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:06 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:53:06 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7377MB free_disk=26.326526641845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1285eca2-575b-4550-a424-605fb186b510 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:53:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:07 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:53:07 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:53:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:53:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 18:53:07 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:53:07 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:08 user nova-compute[71308]: INFO nova.compute.manager [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Detaching volume 1966d299-f72f-45d4-91de-eff266b7e44d
Apr 14 18:53:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:08 user nova-compute[71308]: INFO nova.virt.block_device [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Attempting to driver detach volume 1966d299-f72f-45d4-91de-eff266b7e44d from mountpoint /dev/vdb
Apr 14 18:53:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Attempting to detach device vdb from instance 1285eca2-575b-4550-a424-605fb186b510 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:53:08 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:53:08 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:53:08 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:53:08 user nova-compute[71308]:   <serial>1966d299-f72f-45d4-91de-eff266b7e44d</serial>
Apr 14 18:53:08 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:53:08 user nova-compute[71308]: </disk>
Apr 14 18:53:08 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:53:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Successfully detached device vdb from instance 1285eca2-575b-4550-a424-605fb186b510 from the persistent domain config.
Apr 14 18:53:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1285eca2-575b-4550-a424-605fb186b510 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:53:08 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:53:08 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:53:08 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:53:08 user nova-compute[71308]:   <serial>1966d299-f72f-45d4-91de-eff266b7e44d</serial>
Apr 14 18:53:08 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:53:08 user nova-compute[71308]: </disk>
Apr 14 18:53:08 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498388.8162036, 1285eca2-575b-4550-a424-605fb186b510 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1285eca2-575b-4550-a424-605fb186b510 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:53:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Successfully detached device vdb from instance 1285eca2-575b-4550-a424-605fb186b510 from the live domain config.
Apr 14 18:53:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyEVxbvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:53:08 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb565b0-6963-4c40-b243-add0b59e25f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:53:08 user nova-compute[71308]: No targets found.
Apr 14 18:53:08 user nova-compute[71308]: iSNS:
Apr 14 18:53:08 user nova-compute[71308]: No targets found.
Apr 14 18:53:08 user nova-compute[71308]: STATIC:
Apr 14 18:53:08 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:53:08 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:53:08 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:53:08 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d
Apr 14 18:53:08 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:53:08 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:53:08 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:53:08 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:53:08 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:53:08 user nova-compute[71308]: FIRMWARE:
Apr 14 18:53:08 user nova-compute[71308]: No targets found.
Apr 14 18:53:08 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:53:08 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:53:08 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5521a70-26c4-4521-bb6b-ae16fbf47da4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b3dceb-bc42-4f5e-8961-9b19dc156158]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:08 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:08 user nova-compute[71308]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d (non-flash)
Apr 14 18:53:08 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:08 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:08 user nova-compute[71308]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d (non-flash)
Apr 14 18:53:08 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aaa7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e9fae9-0500-4513-b2d9-74ad9730e829]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b4314-6236-4c31-becc-72ae6e704f31]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[197ec842-7e8a-4059-bc82-da979b978215]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:53:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[695cb1c5-8e97-411b-8457-7f086925d251]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d4ec3-0848-428e-96a3-be1c1bc9107f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38ad431-4ed7-42bf-8206-514c76456741]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d, portal: 172.16.0.220,3260]
Apr 14 18:53:09 user nova-compute[71308]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d, portal: 172.16.0.220,3260] successful.
Apr 14 18:53:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[56559906-1edc-45d4-af00-53f58f58546a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] <== disconnect_volume: return (310ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:53:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.objects.instance [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'flavor' on Instance uuid 1285eca2-575b-4550-a424-605fb186b510 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-bdf2c9fb-72fb-4343-86a0-6ac3211a53fc tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.804s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.680s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:10 user nova-compute[71308]: INFO nova.compute.manager [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Terminating instance
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received event network-vif-unplugged-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] Lock "1285eca2-575b-4550-a424-605fb186b510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] Lock "1285eca2-575b-4550-a424-605fb186b510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] No waiting events found dispatching network-vif-unplugged-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-4327a20c-9a22-4a9b-893d-438d5e9d43ec req-36e7901c-a0e2-41c2-9363-3b781f8619e1 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received event network-vif-unplugged-0ccfdc96-01f1-414d-8693-963f116cfd62 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:53:10 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1285eca2-575b-4550-a424-605fb186b510] Instance destroyed successfully.
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.objects.instance [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lazy-loading 'resources' on Instance uuid 1285eca2-575b-4550-a424-605fb186b510 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1940672222',display_name='tempest-VolumesSnapshotTestJSON-instance-1940672222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1940672222',id=19,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95319509fb6a4e58998703975370877a',ramdisk_id='',reservation_id='r-37lb68zx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1033700636',owner_user_name='tempest-VolumesSnapshotTestJSON-1033700636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:51:06Z,user_data=None,user_id='1f3f788e144c46e7bdf6f4fe3a5aeb79',uuid=1285eca2-575b-4550-a424-605fb186b510,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converting VIF {"id": "0ccfdc96-01f1-414d-8693-963f116cfd62", "address": "fa:16:3e:86:ec:d9", "network": {"id": "6b3ed1e9-fed5-460b-be16-649f80f8992d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1319669286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "95319509fb6a4e58998703975370877a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ccfdc96-01", "ovs_interfaceid": "0ccfdc96-01f1-414d-8693-963f116cfd62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=0ccfdc96-01f1-414d-8693-963f116cfd62,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ccfdc96-01') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_vif [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=0ccfdc96-01f1-414d-8693-963f116cfd62,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ccfdc96-01') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ccfdc96-01, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:10 user nova-compute[71308]: INFO os_vif [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ec:d9,bridge_name='br-int',has_traffic_filtering=True,id=0ccfdc96-01f1-414d-8693-963f116cfd62,network=Network(6b3ed1e9-fed5-460b-be16-649f80f8992d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ccfdc96-01')
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IyEVxbvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:53:10 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[455e5699-39c2-475c-83ed-66ce2074311f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:53:10 user nova-compute[71308]: No targets found.
Apr 14 18:53:10 user nova-compute[71308]: iSNS:
Apr 14 18:53:10 user nova-compute[71308]: No targets found.
Apr 14 18:53:10 user nova-compute[71308]: STATIC:
Apr 14 18:53:10 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:53:10 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:53:10 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:53:10 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:53:10 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:53:10 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:53:10 user nova-compute[71308]: FIRMWARE:
Apr 14 18:53:10 user nova-compute[71308]: No targets found.
Apr 14 18:53:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:53:10 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:53:10 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1966d299-f72f-45d4-91de-eff266b7e44d', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cf360d-4673-4f35-a9b0-e780be28cad9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3c185b-5496-46d6-a029-4b57bae552d7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:10 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:10 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aae0af0>, {}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Disconnecting from: [] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] <== disconnect_volume: return (69ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:53:10 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Deleting instance files /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510_del
Apr 14 18:53:10 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Deletion of /opt/stack/data/nova/instances/1285eca2-575b-4550-a424-605fb186b510_del complete
Apr 14 18:53:10 user nova-compute[71308]: INFO nova.compute.manager [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 18:53:10 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 1285eca2-575b-4550-a424-605fb186b510] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:53:10 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 1285eca2-575b-4550-a424-605fb186b510] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:53:11 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 1285eca2-575b-4550-a424-605fb186b510] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:11 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 1285eca2-575b-4550-a424-605fb186b510] Took 0.71 seconds to deallocate network for instance.
Apr 14 18:53:11 user nova-compute[71308]: WARNING nova.volume.cinder [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Attachment c91e95f9-9b30-4e16-9bc8-4c964d441970 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c91e95f9-9b30-4e16-9bc8-4c964d441970. (HTTP 404) (Request-ID: req-9f0e7c8d-35e4-4efd-9d89-dbf410f75bea)
Apr 14 18:53:11 user nova-compute[71308]: INFO nova.compute.manager [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] [instance: 1285eca2-575b-4550-a424-605fb186b510] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 18:53:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:12 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Deleted allocations for instance 1285eca2-575b-4550-a424-605fb186b510
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4189e303-7a4e-4d4f-9f13-40c94ed8f24f tempest-VolumesSnapshotTestJSON-1033700636 tempest-VolumesSnapshotTestJSON-1033700636-project-member] Lock "1285eca2-575b-4550-a424-605fb186b510" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.171s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:53:12 user nova-compute[71308]: INFO nova.compute.claims [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Claim successful on node user
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received event network-vif-plugged-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] Acquiring lock "1285eca2-575b-4550-a424-605fb186b510-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] Lock "1285eca2-575b-4550-a424-605fb186b510-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] Lock "1285eca2-575b-4550-a424-605fb186b510-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] No waiting events found dispatching network-vif-plugged-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:12 user nova-compute[71308]: WARNING nova.compute.manager [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received unexpected event network-vif-plugged-0ccfdc96-01f1-414d-8693-963f116cfd62 for instance with vm_state deleted and task_state None.
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-63966037-0f48-48db-986b-5e130b0774af req-88cbdf4e-f468-41b6-b87c-6909173970f3 service nova] [instance: 1285eca2-575b-4550-a424-605fb186b510] Received event network-vif-deleted-0ccfdc96-01f1-414d-8693-963f116cfd62 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:53:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.policy [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67e1d31c2d9048699758779dedf7d3ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e6b4e98cf9e4f96b79c3288dfe0da89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:53:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Creating image(s)
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "/opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "/opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "/opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "45a8bb058e67cfd531c56972042eb2de9941abfe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "45a8bb058e67cfd531c56972042eb2de9941abfe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe.part --force-share --output=json" returned: 0 in 0.158s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG nova.virt.images [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 820f1452-474e-4205-aea7-0d8c120229da was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe.part /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Successfully created port: 00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe.part /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe.converted" returned: 0 in 0.279s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "45a8bb058e67cfd531c56972042eb2de9941abfe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.883s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe --force-share --output=json" returned: 0 in 0.130s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "45a8bb058e67cfd531c56972042eb2de9941abfe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "45a8bb058e67cfd531c56972042eb2de9941abfe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe,backing_fmt=raw /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe,backing_fmt=raw /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk 1073741824" returned: 0 in 0.068s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "45a8bb058e67cfd531c56972042eb2de9941abfe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/45a8bb058e67cfd531c56972042eb2de9941abfe --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Successfully updated port: 00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquired lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Cannot resize image /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'migration_context' on Instance uuid cab14831-868c-40aa-b694-9e0185557653 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Ensure instance console log exists: /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing instance network info cache due to event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] Acquiring lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Updating instance_info_cache with network_info: [{"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Releasing lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Instance network_info: |[{"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] Acquired lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.network.neutron [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Start _get_guest_xml network_info=[{"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:53:09Z,direct_url=<?>,disk_format='qcow2',id=820f1452-474e-4205-aea7-0d8c120229da,min_disk=0,min_ram=0,name='tempest-scenario-img--673731344',owner='8e6b4e98cf9e4f96b79c3288dfe0da89',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:53:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '820f1452-474e-4205-aea7-0d8c120229da'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:53:14 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:53:14 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:53:09Z,direct_url=<?>,disk_format='qcow2',id=820f1452-474e-4205-aea7-0d8c120229da,min_disk=0,min_ram=0,name='tempest-scenario-img--673731344',owner='8e6b4e98cf9e4f96b79c3288dfe0da89',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:53:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1520840237',display_name='tempest-TestMinimumBasicScenario-server-1520840237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1520840237',id=23,image_ref='820f1452-474e-4205-aea7-0d8c120229da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOqKy4QJH9Ahk78Dio5o1pKmdxgls1Vij0F1hpELGXEH2iLM2PcaG5f/FMMxqCoIhYjKPIFlM0PNsjOP/N9XDX+woRo9QWFmiSBk1ThRc0RqtjvABAaJ1upzg7Tk3FDAQ==',key_name='tempest-TestMinimumBasicScenario-1594101407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e6b4e98cf9e4f96b79c3288dfe0da89',ramdisk_id='',reservation_id='r-wg3g97ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='820f1452-474e-4205-aea7-0d8c120229da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1257841115',owner_user_name='tempest-TestMinimumBasicScenario-1257841115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:53:13Z,user_data=None,user_id='67e1d31c2d9048699758779dedf7d3ac',uuid=cab14831-868c-40aa-b694-9e0185557653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converting VIF {"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:a9,bridge_name='br-int',has_traffic_filtering=True,id=00582309-5b1a-4a4d-80b2-478c8f9ada29,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00582309-5b') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'pci_devices' on Instance uuid cab14831-868c-40aa-b694-9e0185557653 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:53:14 user nova-compute[71308]:   <uuid>cab14831-868c-40aa-b694-9e0185557653</uuid>
Apr 14 18:53:14 user nova-compute[71308]:   <name>instance-00000017</name>
Apr 14 18:53:14 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:53:14 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:53:14 user nova-compute[71308]:   <metadata>
Apr 14 18:53:14 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:53:14 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:53:14 user nova-compute[71308]:       <nova:name>tempest-TestMinimumBasicScenario-server-1520840237</nova:name>
Apr 14 18:53:14 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:53:14</nova:creationTime>
Apr 14 18:53:14 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:53:14 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:53:14 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:53:14 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:53:14 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:53:14 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:53:14 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:53:14 user nova-compute[71308]:       <nova:owner>
Apr 14 18:53:14 user nova-compute[71308]:         <nova:user uuid="67e1d31c2d9048699758779dedf7d3ac">tempest-TestMinimumBasicScenario-1257841115-project-member</nova:user>
Apr 14 18:53:14 user nova-compute[71308]:         <nova:project uuid="8e6b4e98cf9e4f96b79c3288dfe0da89">tempest-TestMinimumBasicScenario-1257841115</nova:project>
Apr 14 18:53:14 user nova-compute[71308]:       </nova:owner>
Apr 14 18:53:14 user nova-compute[71308]:       <nova:root type="image" uuid="820f1452-474e-4205-aea7-0d8c120229da"/>
Apr 14 18:53:14 user nova-compute[71308]:       <nova:ports>
Apr 14 18:53:14 user nova-compute[71308]:         <nova:port uuid="00582309-5b1a-4a4d-80b2-478c8f9ada29">
Apr 14 18:53:14 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 18:53:14 user nova-compute[71308]:         </nova:port>
Apr 14 18:53:14 user nova-compute[71308]:       </nova:ports>
Apr 14 18:53:14 user nova-compute[71308]:     </nova:instance>
Apr 14 18:53:14 user nova-compute[71308]:   </metadata>
Apr 14 18:53:14 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:53:14 user nova-compute[71308]:     <system>
Apr 14 18:53:14 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:53:14 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:53:14 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:53:14 user nova-compute[71308]:       <entry name="serial">cab14831-868c-40aa-b694-9e0185557653</entry>
Apr 14 18:53:14 user nova-compute[71308]:       <entry name="uuid">cab14831-868c-40aa-b694-9e0185557653</entry>
Apr 14 18:53:14 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:53:14 user nova-compute[71308]:     </system>
Apr 14 18:53:14 user nova-compute[71308]:   </sysinfo>
Apr 14 18:53:14 user nova-compute[71308]:   <os>
Apr 14 18:53:14 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:53:14 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:53:14 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:53:14 user nova-compute[71308]:   </os>
Apr 14 18:53:14 user nova-compute[71308]:   <features>
Apr 14 18:53:14 user nova-compute[71308]:     <acpi/>
Apr 14 18:53:14 user nova-compute[71308]:     <apic/>
Apr 14 18:53:14 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:53:14 user nova-compute[71308]:   </features>
Apr 14 18:53:14 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:53:14 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:53:14 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:53:14 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:53:14 user nova-compute[71308]:   </clock>
Apr 14 18:53:14 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:53:14 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:53:14 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:53:14 user nova-compute[71308]:   </cpu>
Apr 14 18:53:14 user nova-compute[71308]:   <devices>
Apr 14 18:53:14 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:53:14 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:53:14 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk"/>
Apr 14 18:53:14 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:53:14 user nova-compute[71308]:     </disk>
Apr 14 18:53:14 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:53:14 user nova-compute[71308]:       <mac address="fa:16:3e:31:ab:a9"/>
Apr 14 18:53:14 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:53:14 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:53:14 user nova-compute[71308]:       <target dev="tap00582309-5b"/>
Apr 14 18:53:14 user nova-compute[71308]:     </interface>
Apr 14 18:53:14 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:53:14 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/console.log" append="off"/>
Apr 14 18:53:14 user nova-compute[71308]:     </serial>
Apr 14 18:53:14 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:53:14 user nova-compute[71308]:     <video>
Apr 14 18:53:14 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:53:14 user nova-compute[71308]:     </video>
Apr 14 18:53:14 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:53:14 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:53:14 user nova-compute[71308]:     </rng>
Apr 14 18:53:14 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:53:14 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:53:14 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:53:14 user nova-compute[71308]:     </memballoon>
Apr 14 18:53:14 user nova-compute[71308]:   </devices>
Apr 14 18:53:14 user nova-compute[71308]: </domain>
Apr 14 18:53:14 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1520840237',display_name='tempest-TestMinimumBasicScenario-server-1520840237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1520840237',id=23,image_ref='820f1452-474e-4205-aea7-0d8c120229da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOqKy4QJH9Ahk78Dio5o1pKmdxgls1Vij0F1hpELGXEH2iLM2PcaG5f/FMMxqCoIhYjKPIFlM0PNsjOP/N9XDX+woRo9QWFmiSBk1ThRc0RqtjvABAaJ1upzg7Tk3FDAQ==',key_name='tempest-TestMinimumBasicScenario-1594101407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8e6b4e98cf9e4f96b79c3288dfe0da89',ramdisk_id='',reservation_id='r-wg3g97ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='820f1452-474e-4205-aea7-0d8c120229da',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1257841115',owner_user_name='tempest-TestMinimumBasicScenario-1257841115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:53:13Z,user_data=None,user_id='67e1d31c2d9048699758779dedf7d3ac',uuid=cab14831-868c-40aa-b694-9e0185557653,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converting VIF {"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:a9,bridge_name='br-int',has_traffic_filtering=True,id=00582309-5b1a-4a4d-80b2-478c8f9ada29,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00582309-5b') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG os_vif [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:a9,bridge_name='br-int',has_traffic_filtering=True,id=00582309-5b1a-4a4d-80b2-478c8f9ada29,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00582309-5b') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00582309-5b, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00582309-5b, col_values=(('external_ids', {'iface-id': '00582309-5b1a-4a4d-80b2-478c8f9ada29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:ab:a9', 'vm-uuid': 'cab14831-868c-40aa-b694-9e0185557653'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:14 user nova-compute[71308]: INFO os_vif [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ab:a9,bridge_name='br-int',has_traffic_filtering=True,id=00582309-5b1a-4a4d-80b2-478c8f9ada29,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00582309-5b')
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:53:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No VIF found with MAC fa:16:3e:31:ab:a9, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:53:15 user nova-compute[71308]: DEBUG nova.network.neutron [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updated VIF entry in instance network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:53:15 user nova-compute[71308]: DEBUG nova.network.neutron [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updating instance_info_cache with network_info: [{"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4e8b0078-41d8-4508-866e-27f9c1bf2da0 req-b6b86a32-5895-4bc8-93ae-ca751be9ef63 service nova] Releasing lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] No waiting events found dispatching network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:16 user nova-compute[71308]: WARNING nova.compute.manager [req-1572d188-314d-4f51-9ab6-fe44581e5d2c req-a4b947f8-9e78-4e95-98ca-b51f160ef6b0 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received unexpected event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance with vm_state building and task_state spawning.
Apr 14 18:53:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498398.4359658, cab14831-868c-40aa-b694-9e0185557653 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:53:18 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] VM Resumed (Lifecycle Event)
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:53:18 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: cab14831-868c-40aa-b694-9e0185557653] Instance spawned successfully.
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:18 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498398.4382582, cab14831-868c-40aa-b694-9e0185557653 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:53:18 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] VM Started (Lifecycle Event)
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:53:18 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:53:18 user nova-compute[71308]: INFO nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Took 5.63 seconds to spawn the instance on the hypervisor.
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:18 user nova-compute[71308]: INFO nova.compute.manager [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Took 6.41 seconds to build instance.
Apr 14 18:53:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dbdca7e3-e3a3-4b82-b29c-16d7a4a49d44 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.508s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] No waiting events found dispatching network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:18 user nova-compute[71308]: WARNING nova.compute.manager [req-b693144b-18d9-4f13-9e88-eb17833b9695 req-e7915431-8c15-4d66-8d23-da43c5ab5c5c service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received unexpected event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance with vm_state active and task_state None.
Apr 14 18:53:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-changed-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Refreshing instance network info cache due to event network-changed-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:53:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] Acquiring lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:53:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] Acquired lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:53:23 user nova-compute[71308]: DEBUG nova.network.neutron [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Refreshing network info cache for port 2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:53:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updated VIF entry in instance network info cache for port 2dd49e6c-3f3a-4124-aff8-a4a4e898cf21. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:53:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updating instance_info_cache with network_info: [{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e6bb9a42-7500-465c-9eee-aa5443b13ca2 req-dde76c9f-87d3-41a1-8ba0-48198ebb43d0 service nova] Releasing lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:53:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:25 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498390.8081648, 1285eca2-575b-4550-a424-605fb186b510 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:53:25 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 1285eca2-575b-4550-a424-605fb186b510] VM Stopped (Lifecycle Event)
Apr 14 18:53:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-32597fb5-c99f-4dbd-bdb9-b65982aa4696 None None] [instance: 1285eca2-575b-4550-a424-605fb186b510] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG nova.objects.instance [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:26 user nova-compute[71308]: INFO nova.compute.manager [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Attaching volume 8870d3d7-990b-4d4c-8d7a-4591106f1a3a to /dev/vdb
Apr 14 18:53:26 user nova-compute[71308]: DEBUG os_brick.utils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda4340f-fd17-4625-aa42-b20c5c9e3aa8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaf5410-2a63-4900-bd0d-7883b010044a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[284d919b-e98e-406b-a3fe-e8d8432b20f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8563dff3-7704-49ea-b700-3b30fef22421]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:53:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:53:27 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:53:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[54329777-e378-4195-ac5e-aea226d74ed8]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:53:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:53:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:53:27 user nova-compute[71308]: DEBUG os_brick.utils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:53:27 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updating existing volume attachment record: 4ee0a3ad-03ff-4730-85ac-f404d0e6acd6 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:53:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:29 user nova-compute[71308]: INFO nova.compute.manager [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Terminating instance
Apr 14 18:53:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:53:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-unplugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-unplugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-4982dbf7-d0ef-4186-bdfc-01b0f85f2c9f req-ce7dd465-ad69-424e-9535-7912243aa832 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-unplugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:53:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Instance destroyed successfully.
Apr 14 18:53:30 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lazy-loading 'resources' on Instance uuid 8e55c721-9fad-4478-9e74-e87d0c95bc3c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1341803639',display_name='tempest-ServerStableDeviceRescueTest-server-1341803639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1341803639',id=4,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGjNz78QsEg7GY5Q/x5R0+fXhMd4+j5aNId0d7KMgDy/nQskSviXpD3wS5mHEhEb7jjb1W7n7QHncfc1ds0/3pZ7+zPW5nX4bCBjYud5GgMoBiur+7hIWtHB4iei5HABw==',key_name='tempest-keypair-1040648644',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:50:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64d84c59848f445a90eb7eab6be04253',ramdisk_id='',reservation_id='r-2zoj7i2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-728638156',owner_user_name='tempest-ServerStableDeviceRescueTest-728638156-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ed7885e7774691b02c19cf08c2177f',uuid=8e55c721-9fad-4478-9e74-e87d0c95bc3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Converting VIF {"id": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "address": "fa:16:3e:24:d7:82", "network": {"id": "703a8d85-ee89-4c7b-addb-bc6424312027", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023790108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64d84c59848f445a90eb7eab6be04253", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66ba5ca6-da", "ovs_interfaceid": "66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:d7:82,bridge_name='br-int',has_traffic_filtering=True,id=66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3,network=Network(703a8d85-ee89-4c7b-addb-bc6424312027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba5ca6-da') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG os_vif [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:d7:82,bridge_name='br-int',has_traffic_filtering=True,id=66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3,network=Network(703a8d85-ee89-4c7b-addb-bc6424312027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba5ca6-da') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66ba5ca6-da, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:53:30 user nova-compute[71308]: INFO os_vif [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:d7:82,bridge_name='br-int',has_traffic_filtering=True,id=66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3,network=Network(703a8d85-ee89-4c7b-addb-bc6424312027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66ba5ca6-da')
Apr 14 18:53:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Deleting instance files /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c_del
Apr 14 18:53:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Deletion of /opt/stack/data/nova/instances/8e55c721-9fad-4478-9e74-e87d0c95bc3c_del complete
Apr 14 18:53:30 user nova-compute[71308]: INFO nova.compute.manager [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 14 18:53:30 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:53:30 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpShYmcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:53:32 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:53:32 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:53:32 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] Acquiring lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] No waiting events found dispatching network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:32 user nova-compute[71308]: WARNING nova.compute.manager [req-87bbca02-274d-4e28-9ad4-2b59fb0aebeb req-c44cf6de-38ae-46ca-89bd-62ce68e86996 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received unexpected event network-vif-plugged-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 for instance with vm_state active and task_state deleting.
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa708a1a-791a-4988-a94d-9eddc5481f96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:53:32 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e590ea2-b0a4-456e-a6b7-12747c206a19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a] added
Apr 14 18:53:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedac9c9-382b-49ab-bc69-29c35b4ff1a7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f40002b-3105-4015-b0fc-1ef7095bf397]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpShYmcB {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpShYmcB" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[878de794-f2e4-42b5-9d32-7c9d7a15c14b]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zpShYmcB'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[827039c6-e0ba-4a1a-8b35-586abfd4a764]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[889203b0-c3bd-411a-b73b-9255011b590b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0853685a-ec0f-4c30-8de8-868d38c7f81c (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0853685a-ec0f-4c30-8de8-868d38c7f81c (non-flash)
Apr 14 18:53:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0853685a-ec0f-4c30-8de8-868d38c7f81c (non-flash)
Apr 14 18:53:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[389c748a-1ab3-4021-a544-d3d060049ab0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260]
Apr 14 18:53:32 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260] successful.
Apr 14 18:53:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b400bf4a-68a7-4621-85e4-2a11b0c2410c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afc2f57-27a4-4e9e-b071-e9a9be8fa8e7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0853685a-ec0f-4c30-8de8-868d38c7f81c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0853685a-ec0f-4c30-8de8-868d38c7f81c (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:53:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0853685a-ec0f-4c30-8de8-868d38c7f81c (non-flash)
Apr 14 18:53:32 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:53:32 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a69b9f8-58a2-4684-b308-c6e28d17cc11]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpShYmcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:32 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Took 2.03 seconds to deallocate network for instance.
Apr 14 18:53:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-6cf402cf-02f9-47e4-a11d-a7193a1a58e2 req-a771a29a-87d6-44bb-84e9-c9749db62964 service nova] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Received event network-vif-deleted-66ba5ca6-da4b-43dd-ad91-cc0f615bb1f3 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:33 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Deleted allocations for instance 8e55c721-9fad-4478-9e74-e87d0c95bc3c
Apr 14 18:53:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e6873802-1c67-4264-aa90-5d287c7457e6 tempest-ServerStableDeviceRescueTest-728638156 tempest-ServerStableDeviceRescueTest-728638156-project-member] Lock "8e55c721-9fad-4478-9e74-e87d0c95bc3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.654s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26636386334386233', 'path': '/dev/sde'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636386334386233', 'path': '/dev/sde'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG nova.objects.instance [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:53:33 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:53:33 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:53:33 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:53:33 user nova-compute[71308]:   <serial>8870d3d7-990b-4d4c-8d7a-4591106f1a3a</serial>
Apr 14 18:53:33 user nova-compute[71308]: </disk>
Apr 14 18:53:33 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No VIF found with MAC fa:16:3e:18:06:fd, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a6aeede6-81c6-445c-aa00-879ce06991b8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.503s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71308) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG nova.objects.instance [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "97aafe40-5587-41cf-ba75-6077d9daa7eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:53:34 user nova-compute[71308]: INFO nova.compute.claims [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Claim successful on node user
Apr 14 18:53:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:35 user nova-compute[71308]: WARNING nova.compute.manager [req-fc347a61-fcfc-465a-8225-9277c6468349 req-ade72248-c12d-42f8-b66e-0bf61e0848af service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state active and task_state powering-off.
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:53:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance destroyed successfully.
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.policy [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-332b2e82-8e45-455b-8a37-f8f1d0a520f8 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.106s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:53:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Creating image(s)
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "/opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "/opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "/opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.213s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk 1073741824" returned: 0 in 0.063s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.201s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Cannot resize image /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lazy-loading 'migration_context' on Instance uuid 97aafe40-5587-41cf-ba75-6077d9daa7eb {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Ensure instance console log exists: /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Successfully created port: 00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:37 user nova-compute[71308]: WARNING nova.compute.manager [req-0cd8a48e-1889-4c92-9f4d-1e5f1ca9ae60 req-10590354-a0f8-43b2-8966-feeaddc1a7d0 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state stopped and task_state None.
Apr 14 18:53:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Successfully updated port: 00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "refresh_cache-97aafe40-5587-41cf-ba75-6077d9daa7eb" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquired lock "refresh_cache-97aafe40-5587-41cf-ba75-6077d9daa7eb" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received event network-changed-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Refreshing instance network info cache due to event network-changed-00a6b78f-1816-4b0f-956b-3dc23b029449. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] Acquiring lock "refresh_cache-97aafe40-5587-41cf-ba75-6077d9daa7eb" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:53:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Updating instance_info_cache with network_info: [{"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Releasing lock "refresh_cache-97aafe40-5587-41cf-ba75-6077d9daa7eb" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Instance network_info: |[{"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] Acquired lock "refresh_cache-97aafe40-5587-41cf-ba75-6077d9daa7eb" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Refreshing network info cache for port 00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Start _get_guest_xml network_info=[{"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:53:38 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:53:38 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1765673248',display_name='tempest-ServersNegativeTestJSON-server-1765673248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1765673248',id=24,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af68184e7654efea3187e05bb10e5e4',ramdisk_id='',reservation_id='r-jzmw4qv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1532814906',owner_user_name='tempest-ServersNegativeTestJSON-1532814906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:53:36Z,user_data=None,user_id='008a24026e844252b0be1268461bc2b1',uuid=97aafe40-5587-41cf-ba75-6077d9daa7eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converting VIF {"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b6:23,bridge_name='br-int',has_traffic_filtering=True,id=00a6b78f-1816-4b0f-956b-3dc23b029449,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a6b78f-18') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lazy-loading 'pci_devices' on Instance uuid 97aafe40-5587-41cf-ba75-6077d9daa7eb {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:53:38 user nova-compute[71308]:   <uuid>97aafe40-5587-41cf-ba75-6077d9daa7eb</uuid>
Apr 14 18:53:38 user nova-compute[71308]:   <name>instance-00000018</name>
Apr 14 18:53:38 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:53:38 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:53:38 user nova-compute[71308]:   <metadata>
Apr 14 18:53:38 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:53:38 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:53:38 user nova-compute[71308]:       <nova:name>tempest-ServersNegativeTestJSON-server-1765673248</nova:name>
Apr 14 18:53:38 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:53:38</nova:creationTime>
Apr 14 18:53:38 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:53:38 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:53:38 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:53:38 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:53:38 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:53:38 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:53:38 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:53:38 user nova-compute[71308]:       <nova:owner>
Apr 14 18:53:38 user nova-compute[71308]:         <nova:user uuid="008a24026e844252b0be1268461bc2b1">tempest-ServersNegativeTestJSON-1532814906-project-member</nova:user>
Apr 14 18:53:38 user nova-compute[71308]:         <nova:project uuid="4af68184e7654efea3187e05bb10e5e4">tempest-ServersNegativeTestJSON-1532814906</nova:project>
Apr 14 18:53:38 user nova-compute[71308]:       </nova:owner>
Apr 14 18:53:38 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:53:38 user nova-compute[71308]:       <nova:ports>
Apr 14 18:53:38 user nova-compute[71308]:         <nova:port uuid="00a6b78f-1816-4b0f-956b-3dc23b029449">
Apr 14 18:53:38 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 18:53:38 user nova-compute[71308]:         </nova:port>
Apr 14 18:53:38 user nova-compute[71308]:       </nova:ports>
Apr 14 18:53:38 user nova-compute[71308]:     </nova:instance>
Apr 14 18:53:38 user nova-compute[71308]:   </metadata>
Apr 14 18:53:38 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:53:38 user nova-compute[71308]:     <system>
Apr 14 18:53:38 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:53:38 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:53:38 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:53:38 user nova-compute[71308]:       <entry name="serial">97aafe40-5587-41cf-ba75-6077d9daa7eb</entry>
Apr 14 18:53:38 user nova-compute[71308]:       <entry name="uuid">97aafe40-5587-41cf-ba75-6077d9daa7eb</entry>
Apr 14 18:53:38 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:53:38 user nova-compute[71308]:     </system>
Apr 14 18:53:38 user nova-compute[71308]:   </sysinfo>
Apr 14 18:53:38 user nova-compute[71308]:   <os>
Apr 14 18:53:38 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:53:38 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:53:38 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:53:38 user nova-compute[71308]:   </os>
Apr 14 18:53:38 user nova-compute[71308]:   <features>
Apr 14 18:53:38 user nova-compute[71308]:     <acpi/>
Apr 14 18:53:38 user nova-compute[71308]:     <apic/>
Apr 14 18:53:38 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:53:38 user nova-compute[71308]:   </features>
Apr 14 18:53:38 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:53:38 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:53:38 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:53:38 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:53:38 user nova-compute[71308]:   </clock>
Apr 14 18:53:38 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:53:38 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:53:38 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:53:38 user nova-compute[71308]:   </cpu>
Apr 14 18:53:38 user nova-compute[71308]:   <devices>
Apr 14 18:53:38 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:53:38 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:53:38 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk"/>
Apr 14 18:53:38 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:53:38 user nova-compute[71308]:     </disk>
Apr 14 18:53:38 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:53:38 user nova-compute[71308]:       <mac address="fa:16:3e:b7:b6:23"/>
Apr 14 18:53:38 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:53:38 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:53:38 user nova-compute[71308]:       <target dev="tap00a6b78f-18"/>
Apr 14 18:53:38 user nova-compute[71308]:     </interface>
Apr 14 18:53:38 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:53:38 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/console.log" append="off"/>
Apr 14 18:53:38 user nova-compute[71308]:     </serial>
Apr 14 18:53:38 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:53:38 user nova-compute[71308]:     <video>
Apr 14 18:53:38 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:53:38 user nova-compute[71308]:     </video>
Apr 14 18:53:38 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:53:38 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:53:38 user nova-compute[71308]:     </rng>
Apr 14 18:53:38 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:53:38 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:53:38 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:53:38 user nova-compute[71308]:     </memballoon>
Apr 14 18:53:38 user nova-compute[71308]:   </devices>
Apr 14 18:53:38 user nova-compute[71308]: </domain>
Apr 14 18:53:38 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1765673248',display_name='tempest-ServersNegativeTestJSON-server-1765673248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1765673248',id=24,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af68184e7654efea3187e05bb10e5e4',ramdisk_id='',reservation_id='r-jzmw4qv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1532814906',owner_user_name='tempest-ServersNegativeTestJSON-1532814906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:53:36Z,user_data=None,user_id='008a24026e844252b0be1268461bc2b1',uuid=97aafe40-5587-41cf-ba75-6077d9daa7eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converting VIF {"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b6:23,bridge_name='br-int',has_traffic_filtering=True,id=00a6b78f-1816-4b0f-956b-3dc23b029449,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a6b78f-18') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG os_vif [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b6:23,bridge_name='br-int',has_traffic_filtering=True,id=00a6b78f-1816-4b0f-956b-3dc23b029449,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a6b78f-18') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00a6b78f-18, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00a6b78f-18, col_values=(('external_ids', {'iface-id': '00a6b78f-1816-4b0f-956b-3dc23b029449', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:b6:23', 'vm-uuid': '97aafe40-5587-41cf-ba75-6077d9daa7eb'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:38 user nova-compute[71308]: INFO os_vif [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:b6:23,bridge_name='br-int',has_traffic_filtering=True,id=00a6b78f-1816-4b0f-956b-3dc23b029449,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a6b78f-18')
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] No VIF found with MAC fa:16:3e:b7:b6:23, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Updated VIF entry in instance network info cache for port 00a6b78f-1816-4b0f-956b-3dc23b029449. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Updating instance_info_cache with network_info: [{"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6108e273-931d-4c61-9756-8de647b2e8bc req-4d8170cd-9671-4ab3-9412-29320ff0567b service nova] Releasing lock "refresh_cache-97aafe40-5587-41cf-ba75-6077d9daa7eb" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:53:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received event network-vif-plugged-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] Acquiring lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] No waiting events found dispatching network-vif-plugged-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:40 user nova-compute[71308]: WARNING nova.compute.manager [req-b835cc4f-73d5-483c-9285-c1e68be945e8 req-76e9ff6e-f2ea-4616-966c-8c786fc84fbd service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received unexpected event network-vif-plugged-00a6b78f-1816-4b0f-956b-3dc23b029449 for instance with vm_state building and task_state spawning.
Apr 14 18:53:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing instance network info cache due to event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] Acquiring lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] Acquired lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG nova.network.neutron [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:41 user nova-compute[71308]: INFO nova.compute.manager [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Shelve offloading
Apr 14 18:53:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498422.2373583, 97aafe40-5587-41cf-ba75-6077d9daa7eb => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:53:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] VM Resumed (Lifecycle Event)
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:53:42 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Instance spawned successfully.
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received event network-vif-plugged-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Acquiring lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] No waiting events found dispatching network-vif-plugged-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:42 user nova-compute[71308]: WARNING nova.compute.manager [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received unexpected event network-vif-plugged-00a6b78f-1816-4b0f-956b-3dc23b029449 for instance with vm_state building and task_state spawning.
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-unplugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] No waiting events found dispatching network-vif-unplugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:42 user nova-compute[71308]: WARNING nova.compute.manager [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received unexpected event network-vif-unplugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance with vm_state active and task_state shelving.
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] No waiting events found dispatching network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:53:42 user nova-compute[71308]: WARNING nova.compute.manager [req-7322c960-0442-40ba-b1d8-09b364a53a05 req-d8d31b15-8159-4721-a4ab-3587e62d8439 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received unexpected event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance with vm_state active and task_state shelving.
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:53:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498422.2545316, 97aafe40-5587-41cf-ba75-6077d9daa7eb => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:53:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] VM Started (Lifecycle Event)
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updated VIF entry in instance network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:42 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Instance destroyed successfully.
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e94cb708-a63a-4b5c-87e0-4083fd0aa89d req-ba2160c7-88eb-4dd2-ae4e-34bf8946c93e service nova] Releasing lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquired lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:53:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:53:42 user nova-compute[71308]: INFO nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Took 6.69 seconds to spawn the instance on the hypervisor.
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:42 user nova-compute[71308]: INFO nova.compute.manager [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Took 7.82 seconds to build instance.
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8290e422-3bb5-494e-9f83-5f5585dd1575 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.950s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG nova.network.neutron [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Releasing lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:43 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Instance destroyed successfully.
Apr 14 18:53:43 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lazy-loading 'resources' on Instance uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-268762116',display_name='tempest-TestShelveInstance-server-268762116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-268762116',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx6ahRgtQXPgUyewJCWpWITHQipTZzs9c0P8Aj7ZCbMBMa2yXyDTXsh+XmK3wGceblEWwvvTYvKODXsclHUqQnjkGng7EfdTyYzxpc1qTSqvnJNTDFtuZ+jiMrT7Wx64g==',key_name='tempest-TestShelveInstance-756134745',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d0091007734312b8d33caf294d2c65',ramdisk_id='',reservation_id='r-sf7xh3dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-48517904',owner_user_name='tempest-TestShelveInstance-48517904-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:52:00Z,user_data=None,user_id='10e3f2dda9bc49f48c66beb978dbdaca',uuid=a2a860bd-802f-4760-b77b-92b7ac4ad09b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converting VIF {"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_vif [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing instance network info cache due to event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] Acquiring lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] Acquired lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG nova.network.neutron [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce6fcefe-d7, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:43 user nova-compute[71308]: INFO os_vif [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7')
Apr 14 18:53:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWzfbaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:53:43 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee9bb4f-8774-454d-ae20-303f98adf87f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:53:43 user nova-compute[71308]: No targets found.
Apr 14 18:53:43 user nova-compute[71308]: iSNS:
Apr 14 18:53:43 user nova-compute[71308]: No targets found.
Apr 14 18:53:43 user nova-compute[71308]: STATIC:
Apr 14 18:53:43 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a
Apr 14 18:53:43 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:53:43 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:53:43 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:53:43 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:53:43 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:53:43 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:53:43 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:53:43 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:53:43 user nova-compute[71308]: FIRMWARE:
Apr 14 18:53:43 user nova-compute[71308]: No targets found.
Apr 14 18:53:43 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:53:43 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:53:43 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e78dba2-bcae-4e94-8e5a-bd6bcfebe22c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[015987c4-a4c6-430e-b844-3df0d8be0495]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:43 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:43 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:53:43 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:53:43 user nova-compute[71308]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:53:43 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:53:43 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2230742c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[129927ec-7d83-4914-b912-db145edb4722]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[15673d79-034c-40af-95cd-fe10b2487385]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[15866d9b-6d23-4877-ba9d-95d12dd5b4db]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[246ed484-af7f-48fa-9126-3c8010bef5cd]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d273d901-eabe-4d4d-8ba7-8e2d57ee9f03]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5639b65e-a827-466c-92f8-02d1a31639e0]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260]
Apr 14 18:53:44 user nova-compute[71308]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260] successful.
Apr 14 18:53:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f4bccb-977b-4cfb-b67f-179880bc6640]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] <== disconnect_volume: return (314ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:53:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Deleting instance files /opt/stack/data/nova/instances/a2a860bd-802f-4760-b77b-92b7ac4ad09b_del
Apr 14 18:53:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Deletion of /opt/stack/data/nova/instances/a2a860bd-802f-4760-b77b-92b7ac4ad09b_del complete
Apr 14 18:53:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updated VIF entry in instance network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": null, "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:53:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a3d1d6d6-2c56-4ea6-87ea-ecbb3f3f9b11 req-f4c65135-1970-499b-8a42-bd291751eb1d service nova] Releasing lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:53:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:45 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Deleted allocations for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b
Apr 14 18:53:45 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498410.4715471, 8e55c721-9fad-4478-9e74-e87d0c95bc3c => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:53:45 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] VM Stopped (Lifecycle Event)
Apr 14 18:53:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:53:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:53:45 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lazy-loading 'numa_topology' on Instance uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:53:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a0140745-5281-4ea6-89a7-84febaf3f523 None None] [instance: 8e55c721-9fad-4478-9e74-e87d0c95bc3c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:45 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:53:45 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:53:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c07db86d-8fca-4630-9d31-f8694a4f1d23 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.402s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:53:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:50 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498415.54304, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:53:50 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] VM Stopped (Lifecycle Event)
Apr 14 18:53:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-29b5f348-f1a3-4997-9eec-efc1f845b567 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-29b5f348-f1a3-4997-9eec-efc1f845b567 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:53:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:53:57 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498422.3422914, a2a860bd-802f-4760-b77b-92b7ac4ad09b => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:53:57 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] VM Stopped (Lifecycle Event)
Apr 14 18:53:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-c0a14fde-f668-44f3-aa28-a8f09e8785b0 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:53:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:53:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:00 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:00 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:54:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:04 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:08 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:54:08 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7773MB free_disk=26.345802307128906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cab14831-868c-40aa-b694-9e0185557653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG nova.objects.instance [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'flavor' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:09 user nova-compute[71308]: INFO nova.compute.manager [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attaching volume 1aca5780-bd08-43d5-af3e-b06f7501fdbe to /dev/vdb
Apr 14 18:54:09 user nova-compute[71308]: DEBUG os_brick.utils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d73e7f-5c7b-4128-a8f6-35f252747f97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ce027-6a01-41fe-a838-2c9b2615626e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dbcc70-9112-4af8-bfe7-41d91339336e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f83c91-ed60-4f88-80b2-c8779d2c0f7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lazy-loading 'info_cache' on Instance uuid 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:54:09 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:54:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac8ea38-7437-45df-84b0-6ff6c44c9a4f]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG os_brick.utils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:54:09 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating existing volume attachment record: 9755924e-4bd0-4adc-b6e8-07653fe6ebe6 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:54:10 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updating instance_info_cache with network_info: [{"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:54:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:54:10 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:54:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:54:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:54:14 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:54:14 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:54:14 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb4564f-fbb1-48cc-8128-3844cdd2a0e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:54:14 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd56d38-420d-4899-81d4-a67b56620ef5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe] added
Apr 14 18:54:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b807b878-6fc3-4c05-815c-5a5f46757f18]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf55f2c-bc06-4d9d-916e-3e09f71ff68c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVmnceLN {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVmnceLN" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b51843e-6259-47c5-a22c-2202e7b40d9c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bVmnceLN'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[926a20b4-8636-4baa-abac-5b336da8314f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76ef90f-cec4-410e-9139-4540b1dfe712]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:14 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:14 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7720e6a2-d05e-4def-9e62-fecb97599832]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]
Apr 14 18:54:14 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.
Apr 14 18:54:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dcc975-bcf3-4a80-ba44-f596b2277876]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dea428-d4bc-48b0-a632-ba1f29710699]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:14 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:14 user nova-compute[71308]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:14 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:14 user nova-compute[71308]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb85d005-83e2-4812-bff7-10171507dac6]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:54:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:54:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:54:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23932386531386633', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:54:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932386531386633', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:54:15 user nova-compute[71308]: DEBUG nova.objects.instance [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'flavor' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:54:15 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:54:15 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 18:54:15 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:54:15 user nova-compute[71308]:   <serial>1aca5780-bd08-43d5-af3e-b06f7501fdbe</serial>
Apr 14 18:54:15 user nova-compute[71308]: </disk>
Apr 14 18:54:15 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:54:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:54:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:54:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No VIF found with MAC fa:16:3e:11:69:69, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:54:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-26225ad0-528a-4ff2-a96a-bec97cfbf780 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.802s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Stashing vm_state: active {{(pid=71308) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 18:54:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:19 user nova-compute[71308]: DEBUG nova.objects.instance [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'pci_requests' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:54:19 user nova-compute[71308]: INFO nova.compute.claims [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Claim successful on node user
Apr 14 18:54:19 user nova-compute[71308]: DEBUG nova.objects.instance [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'resources' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:19 user nova-compute[71308]: DEBUG nova.objects.instance [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'pci_devices' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:19 user nova-compute[71308]: INFO nova.compute.resource_tracker [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating resource usage from migration d3b949eb-76a1-4e9b-86ed-14f3dd853313
Apr 14 18:54:19 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:54:19 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:54:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.496s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:19 user nova-compute[71308]: INFO nova.compute.manager [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Migrating
Apr 14 18:54:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:54:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:54:19 user nova-compute[71308]: INFO nova.compute.rpcapi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 18:54:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:54:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:54:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:54:19 user nova-compute[71308]: DEBUG nova.network.neutron [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG nova.network.neutron [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Starting migrate_disk_and_power_off {{(pid=71308) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:54:20 user nova-compute[71308]: WARNING nova.compute.manager [req-192f3dbd-efdd-446e-9a7a-2713dbed6604 req-7a3a7093-9148-4b16-9f33-4b06bf548345 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state active and task_state resize_migrating.
Apr 14 18:54:21 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance destroyed successfully.
Apr 14 18:54:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:54:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:11:69:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:11:69:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_vif [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2afe22e1-00, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:21 user nova-compute[71308]: INFO os_vif [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00')
Apr 14 18:54:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:54:21 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[30551932-78f6-4b15-910a-89bf7b1c8425]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:54:21 user nova-compute[71308]: No targets found.
Apr 14 18:54:21 user nova-compute[71308]: iSNS:
Apr 14 18:54:21 user nova-compute[71308]: No targets found.
Apr 14 18:54:21 user nova-compute[71308]: STATIC:
Apr 14 18:54:21 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:54:21 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:54:21 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:54:21 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a
Apr 14 18:54:21 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:54:21 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:54:21 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:54:21 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:54:21 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:54:21 user nova-compute[71308]: FIRMWARE:
Apr 14 18:54:21 user nova-compute[71308]: No targets found.
Apr 14 18:54:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:54:21 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:54:21 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d1aad3-e01d-472e-b0a5-3b375b2af027]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[de88defe-01b0-4c2e-94f8-27536497b41d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:21 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:21 user nova-compute[71308]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:21 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:21 user nova-compute[71308]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22540fb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb97f15f-271d-461e-a2d2-f4e7e27a646a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[395e18fe-efb3-4dfe-8b35-7ad778a34ff5]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45dea8e-c273-4ecf-86d0-5dcf64d79c6e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf49248-c5fe-4a87-b6db-c021c4c93192]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[46204f82-6fbb-45e7-85a1-3afba35b1d11]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6ccd42-451b-4424-9751-9a1932af1353]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]
Apr 14 18:54:21 user nova-compute[71308]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.
Apr 14 18:54:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e9f2c-713a-4049-ac32-34e7435d6bf7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== disconnect_volume: return (317ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:54:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be_resize/disk /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "cp -r /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be_resize/disk /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk" returned: 0 in 0.278s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be_resize/disk.info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk.info {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "cp -r /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be_resize/disk.info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk.info" returned: 0 in 0.032s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:54:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:54:22 user nova-compute[71308]: WARNING nova.compute.manager [req-d305c143-9051-45f8-a933-c4f6d650e697 req-2775f0e2-2707-4b0f-831b-092e227f2d79 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state active and task_state resize_migrating.
Apr 14 18:54:23 user nova-compute[71308]: DEBUG nova.network.neutron [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Port 2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 binding to destination host user is already ACTIVE {{(pid=71308) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 18:54:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:54:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:54:23 user nova-compute[71308]: DEBUG nova.network.neutron [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:54:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG os_brick.utils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae30e0-8f12-4e4a-95ee-976e9952f7fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5296b96a-1e51-41e7-8e7e-ff8e130257dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[52afa209-d7bc-48f2-98bf-d99c1c11b34b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b83f99-0eac-4ba8-961b-d9056ed7879e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:54:24 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:54:24 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1def186a-9816-425d-86ad-1b283f0459fe]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:54:24 user nova-compute[71308]: DEBUG os_brick.utils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:54:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Starting finish_migration {{(pid=71308) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 18:54:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance directory exists: not creating {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 18:54:28 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Creating image(s)
Apr 14 18:54:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'trusted_certs' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.154s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Cannot resize image /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Ensure instance console log exists: /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Start _get_guest_xml network_info=[{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:11:69:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '864d4ffc-9750-427d-b680-8c89d050b32a', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be', 'attached_at': '2023-04-14T18:54:29.000000', 'detached_at': '', 'volume_id': '1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'serial': '1aca5780-bd08-43d5-af3e-b06f7501fdbe'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:54:29 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:54:29 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:54:29 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:54:29 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:54:29 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd387c84-8048-4b8e-bbce-e0bddeced4f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:54:29 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c913688-3abd-4d40-b4ee-4e83db4a890f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe] added
Apr 14 18:54:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff83d954-78ae-4801-bf26-30fa3ba54752]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf082421-3ae5-4609-90cc-557f24ab08df]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVmnceLN {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVmnceLN" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[738feacc-4390-4b7a-8de5-184a780a6456]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bVmnceLN'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[75494799-b7b7-4251-b5c0-85fe73d77a27]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2795e9-571f-4657-9af1-0baa969fcd88]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:29 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:29 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c100600-e2b4-4eb6-b382-2243b8b7879f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]
Apr 14 18:54:29 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.
Apr 14 18:54:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2939f8b7-b417-4210-ac77-e6785b1aa7ea]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a83f1d-233b-4dbd-8557-dd30386a287c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:29 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:29 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:29 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:29 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[08588f68-6a4e-44b3-96fd-955d342c8104]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:54:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23932386531386633', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932386531386633', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:11:69:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:11:69:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:54:30 user nova-compute[71308]:   <uuid>aa09363f-435d-4fa8-9f11-db0c3f4e08be</uuid>
Apr 14 18:54:30 user nova-compute[71308]:   <name>instance-00000005</name>
Apr 14 18:54:30 user nova-compute[71308]:   <memory>196608</memory>
Apr 14 18:54:30 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:54:30 user nova-compute[71308]:   <metadata>
Apr 14 18:54:30 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:54:30 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:54:30 user nova-compute[71308]:       <nova:name>tempest-ServerActionsTestJSON-server-1006128169</nova:name>
Apr 14 18:54:30 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:54:29</nova:creationTime>
Apr 14 18:54:30 user nova-compute[71308]:       <nova:flavor name="m1.micro">
Apr 14 18:54:30 user nova-compute[71308]:         <nova:memory>192</nova:memory>
Apr 14 18:54:30 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:54:30 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:54:30 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:54:30 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:54:30 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:54:30 user nova-compute[71308]:       <nova:owner>
Apr 14 18:54:30 user nova-compute[71308]:         <nova:user uuid="55fa4abe2fdd48cb91f39bf8156a7793">tempest-ServerActionsTestJSON-2112054326-project-member</nova:user>
Apr 14 18:54:30 user nova-compute[71308]:         <nova:project uuid="f028a79640b848228dc6e654a0eef49b">tempest-ServerActionsTestJSON-2112054326</nova:project>
Apr 14 18:54:30 user nova-compute[71308]:       </nova:owner>
Apr 14 18:54:30 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:54:30 user nova-compute[71308]:       <nova:ports>
Apr 14 18:54:30 user nova-compute[71308]:         <nova:port uuid="2afe22e1-0044-47e2-ba5f-e1d9fd6d0620">
Apr 14 18:54:30 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 18:54:30 user nova-compute[71308]:         </nova:port>
Apr 14 18:54:30 user nova-compute[71308]:       </nova:ports>
Apr 14 18:54:30 user nova-compute[71308]:     </nova:instance>
Apr 14 18:54:30 user nova-compute[71308]:   </metadata>
Apr 14 18:54:30 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:54:30 user nova-compute[71308]:     <system>
Apr 14 18:54:30 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:54:30 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:54:30 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:54:30 user nova-compute[71308]:       <entry name="serial">aa09363f-435d-4fa8-9f11-db0c3f4e08be</entry>
Apr 14 18:54:30 user nova-compute[71308]:       <entry name="uuid">aa09363f-435d-4fa8-9f11-db0c3f4e08be</entry>
Apr 14 18:54:30 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:54:30 user nova-compute[71308]:     </system>
Apr 14 18:54:30 user nova-compute[71308]:   </sysinfo>
Apr 14 18:54:30 user nova-compute[71308]:   <os>
Apr 14 18:54:30 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:54:30 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:54:30 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:54:30 user nova-compute[71308]:   </os>
Apr 14 18:54:30 user nova-compute[71308]:   <features>
Apr 14 18:54:30 user nova-compute[71308]:     <acpi/>
Apr 14 18:54:30 user nova-compute[71308]:     <apic/>
Apr 14 18:54:30 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:54:30 user nova-compute[71308]:   </features>
Apr 14 18:54:30 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:54:30 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:54:30 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:54:30 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:54:30 user nova-compute[71308]:   </clock>
Apr 14 18:54:30 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:54:30 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:54:30 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:54:30 user nova-compute[71308]:   </cpu>
Apr 14 18:54:30 user nova-compute[71308]:   <devices>
Apr 14 18:54:30 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:54:30 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:54:30 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk"/>
Apr 14 18:54:30 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:54:30 user nova-compute[71308]:     </disk>
Apr 14 18:54:30 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:54:30 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:54:30 user nova-compute[71308]:       <source dev="/dev/sdb"/>
Apr 14 18:54:30 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:54:30 user nova-compute[71308]:       <serial>1aca5780-bd08-43d5-af3e-b06f7501fdbe</serial>
Apr 14 18:54:30 user nova-compute[71308]:     </disk>
Apr 14 18:54:30 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:54:30 user nova-compute[71308]:       <mac address="fa:16:3e:11:69:69"/>
Apr 14 18:54:30 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:54:30 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:54:30 user nova-compute[71308]:       <target dev="tap2afe22e1-00"/>
Apr 14 18:54:30 user nova-compute[71308]:     </interface>
Apr 14 18:54:30 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:54:30 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/console.log" append="off"/>
Apr 14 18:54:30 user nova-compute[71308]:     </serial>
Apr 14 18:54:30 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:54:30 user nova-compute[71308]:     <video>
Apr 14 18:54:30 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:54:30 user nova-compute[71308]:     </video>
Apr 14 18:54:30 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:54:30 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:54:30 user nova-compute[71308]:     </rng>
Apr 14 18:54:30 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:54:30 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:54:30 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:54:30 user nova-compute[71308]:     </memballoon>
Apr 14 18:54:30 user nova-compute[71308]:   </devices>
Apr 14 18:54:30 user nova-compute[71308]: </domain>
Apr 14 18:54:30 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:11:69:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:11:69:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG os_vif [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2afe22e1-00, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2afe22e1-00, col_values=(('external_ids', {'iface-id': '2afe22e1-0044-47e2-ba5f-e1d9fd6d0620', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:69:69', 'vm-uuid': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:30 user nova-compute[71308]: INFO os_vif [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00')
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:54:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No VIF found with MAC fa:16:3e:11:69:69, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:54:32 user nova-compute[71308]: WARNING nova.compute.manager [req-b3abf097-efd5-4077-911a-0b5668ae9a83 req-5f862402-b61d-4706-980b-ee807030e7e9 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state active and task_state resize_finish.
Apr 14 18:54:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for aa09363f-435d-4fa8-9f11-db0c3f4e08be due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498474.609223, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:54:34 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Resumed (Lifecycle Event)
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:54:34 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance running successfully.
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Failed to set time: agent not configured {{(pid=71308) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-3c72af67-55bb-4d4a-bf98-4c3c7d28d772 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] finish_migration finished successfully. {{(pid=71308) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:54:34 user nova-compute[71308]: WARNING nova.compute.manager [req-8012bbf6-2a94-4385-a957-4d59ef6436d1 req-6ae47f8c-7f9e-4909-bdf6-f44b0f33c343 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state active and task_state resize_finish.
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:54:34 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498474.610508, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:54:34 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Started (Lifecycle Event)
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:54:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:54:34 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 18:54:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:54:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:54:36 user nova-compute[71308]: INFO nova.compute.claims [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Claim successful on node user
Apr 14 18:54:36 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:54:36 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:54:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:54:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:54:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:54:37 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:54:37 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:54:37 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Creating image(s)
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "/opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "/opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG nova.policy [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received event network-changed-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Refreshing instance network info cache due to event network-changed-62d648bd-cf77-401d-abcf-b4f95e339dc9. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] Acquiring lock "refresh_cache-61944d61-738b-42a7-a95d-8caa6fa29a38" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] Acquired lock "refresh_cache-61944d61-738b-42a7-a95d-8caa6fa29a38" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG nova.network.neutron [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Refreshing network info cache for port 62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.176s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.221s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk 1073741824" returned: 0 in 0.075s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.182s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:54:37 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:38 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:38 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Cannot resize image /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:54:38 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'migration_context' on Instance uuid 6e79e2cb-54c5-487e-b852-49303ee3e3cc {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:54:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Ensure instance console log exists: /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:54:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:39 user nova-compute[71308]: DEBUG nova.network.neutron [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Updated VIF entry in instance network info cache for port 62d648bd-cf77-401d-abcf-b4f95e339dc9. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:54:39 user nova-compute[71308]: DEBUG nova.network.neutron [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Updating instance_info_cache with network_info: [{"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:54:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c552625b-761d-4d02-84cf-58be7eb3b01e req-432ace2c-f782-4776-ac3b-4b82f1853bc6 service nova] Releasing lock "refresh_cache-61944d61-738b-42a7-a95d-8caa6fa29a38" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:54:39 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Successfully created port: fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.objects.instance [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'flavor' on Instance uuid 61944d61-738b-42a7-a95d-8caa6fa29a38 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Successfully updated port: fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received event network-changed-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Refreshing instance network info cache due to event network-changed-fdf3f209-95c6-4369-a6b6-13c2aed1371b. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] Acquiring lock "refresh_cache-6e79e2cb-54c5-487e-b852-49303ee3e3cc" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] Acquired lock "refresh_cache-6e79e2cb-54c5-487e-b852-49303ee3e3cc" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.network.neutron [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Refreshing network info cache for port fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "refresh_cache-6e79e2cb-54c5-487e-b852-49303ee3e3cc" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.150s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.network.neutron [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:40 user nova-compute[71308]: INFO nova.compute.manager [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Attaching volume ef45e048-9581-480e-be21-715dfeb0c8cd to /dev/vdb
Apr 14 18:54:40 user nova-compute[71308]: DEBUG os_brick.utils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.network.neutron [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9953e06e-2f92-47a1-aecb-be1dbe67ad42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b595754d-6d82-4821-be03-d3e1d0e1631c req-a26ea5e6-b5b7-4b1d-b8a7-ac41ea345139 service nova] Releasing lock "refresh_cache-6e79e2cb-54c5-487e-b852-49303ee3e3cc" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquired lock "refresh_cache-6e79e2cb-54c5-487e-b852-49303ee3e3cc" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9190121-e843-4fcd-a469-b9a881a2f852]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02873c2-e8f1-467c-b3f0-7dbeed141d32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70c4506-ff20-4fd9-89b5-7f662f8ffdaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:54:40 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[23edfabb-5931-47b9-ac9f-56de3bf34ec8]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG os_brick.utils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Updating existing volume attachment record: 3d51ed88-cc08-47f1-b9bb-0021431752b6 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.network.neutron [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Updating instance_info_cache with network_info: [{"id": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "address": "fa:16:3e:18:6f:90", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf3f209-95", "ovs_interfaceid": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Releasing lock "refresh_cache-6e79e2cb-54c5-487e-b852-49303ee3e3cc" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Instance network_info: |[{"id": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "address": "fa:16:3e:18:6f:90", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf3f209-95", "ovs_interfaceid": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Start _get_guest_xml network_info=[{"id": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "address": "fa:16:3e:18:6f:90", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf3f209-95", "ovs_interfaceid": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:54:40 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:54:40 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:54:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-758523543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-758523543',id=25,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-kda3ngt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:54:37Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=6e79e2cb-54c5-487e-b852-49303ee3e3cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "address": "fa:16:3e:18:6f:90", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf3f209-95", "ovs_interfaceid": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "address": "fa:16:3e:18:6f:90", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf3f209-95", "ovs_interfaceid": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=fdf3f209-95c6-4369-a6b6-13c2aed1371b,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf3f209-95') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e79e2cb-54c5-487e-b852-49303ee3e3cc {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:54:41 user nova-compute[71308]:   <uuid>6e79e2cb-54c5-487e-b852-49303ee3e3cc</uuid>
Apr 14 18:54:41 user nova-compute[71308]:   <name>instance-00000019</name>
Apr 14 18:54:41 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:54:41 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:54:41 user nova-compute[71308]:   <metadata>
Apr 14 18:54:41 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:54:41 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:54:41 user nova-compute[71308]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-758523543</nova:name>
Apr 14 18:54:41 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:54:40</nova:creationTime>
Apr 14 18:54:41 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:54:41 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:54:41 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:54:41 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:54:41 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:54:41 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:54:41 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:54:41 user nova-compute[71308]:       <nova:owner>
Apr 14 18:54:41 user nova-compute[71308]:         <nova:user uuid="a644b8bb9b90494ba670da8315bfe005">tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member</nova:user>
Apr 14 18:54:41 user nova-compute[71308]:         <nova:project uuid="424e732759884efa8fd126cd9a082c8a">tempest-ServerBootFromVolumeStableRescueTest-1815450365</nova:project>
Apr 14 18:54:41 user nova-compute[71308]:       </nova:owner>
Apr 14 18:54:41 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:54:41 user nova-compute[71308]:       <nova:ports>
Apr 14 18:54:41 user nova-compute[71308]:         <nova:port uuid="fdf3f209-95c6-4369-a6b6-13c2aed1371b">
Apr 14 18:54:41 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 18:54:41 user nova-compute[71308]:         </nova:port>
Apr 14 18:54:41 user nova-compute[71308]:       </nova:ports>
Apr 14 18:54:41 user nova-compute[71308]:     </nova:instance>
Apr 14 18:54:41 user nova-compute[71308]:   </metadata>
Apr 14 18:54:41 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:54:41 user nova-compute[71308]:     <system>
Apr 14 18:54:41 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:54:41 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:54:41 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:54:41 user nova-compute[71308]:       <entry name="serial">6e79e2cb-54c5-487e-b852-49303ee3e3cc</entry>
Apr 14 18:54:41 user nova-compute[71308]:       <entry name="uuid">6e79e2cb-54c5-487e-b852-49303ee3e3cc</entry>
Apr 14 18:54:41 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:54:41 user nova-compute[71308]:     </system>
Apr 14 18:54:41 user nova-compute[71308]:   </sysinfo>
Apr 14 18:54:41 user nova-compute[71308]:   <os>
Apr 14 18:54:41 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:54:41 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:54:41 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:54:41 user nova-compute[71308]:   </os>
Apr 14 18:54:41 user nova-compute[71308]:   <features>
Apr 14 18:54:41 user nova-compute[71308]:     <acpi/>
Apr 14 18:54:41 user nova-compute[71308]:     <apic/>
Apr 14 18:54:41 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:54:41 user nova-compute[71308]:   </features>
Apr 14 18:54:41 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:54:41 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:54:41 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:54:41 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:54:41 user nova-compute[71308]:   </clock>
Apr 14 18:54:41 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:54:41 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:54:41 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:54:41 user nova-compute[71308]:   </cpu>
Apr 14 18:54:41 user nova-compute[71308]:   <devices>
Apr 14 18:54:41 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:54:41 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:54:41 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk"/>
Apr 14 18:54:41 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:54:41 user nova-compute[71308]:     </disk>
Apr 14 18:54:41 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:54:41 user nova-compute[71308]:       <mac address="fa:16:3e:18:6f:90"/>
Apr 14 18:54:41 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:54:41 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:54:41 user nova-compute[71308]:       <target dev="tapfdf3f209-95"/>
Apr 14 18:54:41 user nova-compute[71308]:     </interface>
Apr 14 18:54:41 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:54:41 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/console.log" append="off"/>
Apr 14 18:54:41 user nova-compute[71308]:     </serial>
Apr 14 18:54:41 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:54:41 user nova-compute[71308]:     <video>
Apr 14 18:54:41 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:54:41 user nova-compute[71308]:     </video>
Apr 14 18:54:41 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:54:41 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:54:41 user nova-compute[71308]:     </rng>
Apr 14 18:54:41 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:54:41 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:54:41 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:54:41 user nova-compute[71308]:     </memballoon>
Apr 14 18:54:41 user nova-compute[71308]:   </devices>
Apr 14 18:54:41 user nova-compute[71308]: </domain>
Apr 14 18:54:41 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-758523543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-758523543',id=25,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-kda3ngt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:54:37Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=6e79e2cb-54c5-487e-b852-49303ee3e3cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "address": "fa:16:3e:18:6f:90", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf3f209-95", "ovs_interfaceid": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "address": "fa:16:3e:18:6f:90", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf3f209-95", "ovs_interfaceid": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=fdf3f209-95c6-4369-a6b6-13c2aed1371b,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf3f209-95') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG os_vif [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=fdf3f209-95c6-4369-a6b6-13c2aed1371b,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf3f209-95') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdf3f209-95, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdf3f209-95, col_values=(('external_ids', {'iface-id': 'fdf3f209-95c6-4369-a6b6-13c2aed1371b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:6f:90', 'vm-uuid': '6e79e2cb-54c5-487e-b852-49303ee3e3cc'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:41 user nova-compute[71308]: INFO os_vif [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=fdf3f209-95c6-4369-a6b6-13c2aed1371b,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf3f209-95')
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:54:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No VIF found with MAC fa:16:3e:18:6f:90, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:54:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received event network-vif-plugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:54:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] Acquiring lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] No waiting events found dispatching network-vif-plugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:54:43 user nova-compute[71308]: WARNING nova.compute.manager [req-c436c5d2-03e2-415f-9668-9671911ea21f req-0c230d1d-5fd3-4a90-b537-fbb11591cc86 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received unexpected event network-vif-plugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance with vm_state building and task_state spawning.
Apr 14 18:54:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received event network-vif-plugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] Acquiring lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] No waiting events found dispatching network-vif-plugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:54:45 user nova-compute[71308]: WARNING nova.compute.manager [req-ff535655-fc35-4435-9431-fbbf10aee695 req-9224197b-2409-42ed-b15c-d9874ded1c95 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received unexpected event network-vif-plugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance with vm_state building and task_state spawning.
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498485.1554635, 6e79e2cb-54c5-487e-b852-49303ee3e3cc => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:54:45 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] VM Resumed (Lifecycle Event)
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:54:45 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Instance spawned successfully.
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:54:45 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498485.1606877, 6e79e2cb-54c5-487e-b852-49303ee3e3cc => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:54:45 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] VM Started (Lifecycle Event)
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:54:45 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:54:45 user nova-compute[71308]: INFO nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Took 8.14 seconds to spawn the instance on the hypervisor.
Apr 14 18:54:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:54:45 user nova-compute[71308]: INFO nova.compute.manager [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Took 9.31 seconds to build instance.
Apr 14 18:54:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b64518cd-2783-4759-a162-24203e25a313 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.534s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyKiqvEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:54:46 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:54:46 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:54:46 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2105d77c-f802-483c-8c0d-116d99dfa240]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:54:46 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb8bc4-7dd5-4a85-8601-98866258b6a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd] added
Apr 14 18:54:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[25321300-717b-4e05-ab22-2e5966a1e6c5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d433f4a4-a664-4642-b065-f99dcc3b8931]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyKiqvEQ {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gyKiqvEQ" returned: 0 in 0.036s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec54ba8d-708d-4cd4-908a-2fccc868db3d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gyKiqvEQ'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6553fe2-ba29-4df3-a4ed-03324d2c6860]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e6a8fb-5f1a-4da2-a384-050ec1a831c9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc490f1-781c-4039-bd4f-c1c03e72ffad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd, portal: 172.16.0.220,3260]
Apr 14 18:54:46 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd, portal: 172.16.0.220,3260] successful.
Apr 14 18:54:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e59aad-03f3-480e-84fd-0023782aac58]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2073e2a2-10c9-4ee3-a004-0d946e04d707]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd (non-flash)
Apr 14 18:54:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:46 user nova-compute[71308]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd (non-flash)
Apr 14 18:54:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bf1bd4-ff71-4db7-bb2a-9cae41c4cb64]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:54:47 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:54:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyKiqvEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:54:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:54:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '26665313162303034', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:54:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665313162303034', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:54:47 user nova-compute[71308]: DEBUG nova.objects.instance [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'flavor' on Instance uuid 61944d61-738b-42a7-a95d-8caa6fa29a38 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:54:47 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:54:47 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:54:47 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:54:47 user nova-compute[71308]:   <serial>ef45e048-9581-480e-be21-715dfeb0c8cd</serial>
Apr 14 18:54:47 user nova-compute[71308]: </disk>
Apr 14 18:54:47 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:54:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:54:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:54:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No VIF found with MAC fa:16:3e:d7:78:30, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:54:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5b30debe-2074-4de3-9949-7749744c98ea tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.884s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:54:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:54:49 user nova-compute[71308]: INFO nova.compute.manager [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Detaching volume ef45e048-9581-480e-be21-715dfeb0c8cd
Apr 14 18:54:49 user nova-compute[71308]: INFO nova.virt.block_device [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Attempting to driver detach volume ef45e048-9581-480e-be21-715dfeb0c8cd from mountpoint /dev/vdb
Apr 14 18:54:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Attempting to detach device vdb from instance 61944d61-738b-42a7-a95d-8caa6fa29a38 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:54:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:54:49 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:54:49 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:54:49 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:54:49 user nova-compute[71308]:   <serial>ef45e048-9581-480e-be21-715dfeb0c8cd</serial>
Apr 14 18:54:49 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:54:49 user nova-compute[71308]: </disk>
Apr 14 18:54:49 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:54:49 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully detached device vdb from instance 61944d61-738b-42a7-a95d-8caa6fa29a38 from the persistent domain config.
Apr 14 18:54:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61944d61-738b-42a7-a95d-8caa6fa29a38 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:54:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:54:49 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:54:49 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:54:49 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:54:49 user nova-compute[71308]:   <serial>ef45e048-9581-480e-be21-715dfeb0c8cd</serial>
Apr 14 18:54:49 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:54:49 user nova-compute[71308]: </disk>
Apr 14 18:54:49 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498490.2190866, 61944d61-738b-42a7-a95d-8caa6fa29a38 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61944d61-738b-42a7-a95d-8caa6fa29a38 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:54:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully detached device vdb from instance 61944d61-738b-42a7-a95d-8caa6fa29a38 from the live domain config.
Apr 14 18:54:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gyKiqvEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:54:50 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[15007cd7-5f79-4177-9a5b-5ad79cd11d89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:54:50 user nova-compute[71308]: No targets found.
Apr 14 18:54:50 user nova-compute[71308]: iSNS:
Apr 14 18:54:50 user nova-compute[71308]: No targets found.
Apr 14 18:54:50 user nova-compute[71308]: STATIC:
Apr 14 18:54:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:54:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:54:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:54:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a
Apr 14 18:54:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:54:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:54:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd
Apr 14 18:54:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:54:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:54:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:54:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:54:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:54:50 user nova-compute[71308]: FIRMWARE:
Apr 14 18:54:50 user nova-compute[71308]: No targets found.
Apr 14 18:54:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:54:50 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:54:50 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dffc21-0e7a-4595-a6f3-ce405e273f2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f88ef16-b9cc-40df-9239-aa5942acb894]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:50 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:50 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:50 user nova-compute[71308]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd (non-flash)
Apr 14 18:54:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:54:50 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:54:50 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:54:50 user nova-compute[71308]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd (non-flash)
Apr 14 18:54:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22741680d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[db67af7b-5321-4489-b37d-464ecf683779]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[449bb867-2556-4de2-ae47-d9b1f08565d3]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f89f172-ca43-412e-8c22-58cfe75b8767]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1921bbc0-9832-4372-95de-30b20dfd9920]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a998749c-e7d6-4fa5-8e1b-c7c375ae6320]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.150s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f50394b-7b4f-47d4-8357-b89dcad66483]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd, portal: 172.16.0.220,3260]
Apr 14 18:54:50 user nova-compute[71308]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd, portal: 172.16.0.220,3260] successful.
Apr 14 18:54:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef45e048-9581-480e-be21-715dfeb0c8cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2870c-83ff-4c30-bb74-58f8a711ddad]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] <== disconnect_volume: return (435ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:54:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:54:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:51 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'flavor' on Instance uuid 61944d61-738b-42a7-a95d-8caa6fa29a38 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:54:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8287b4dc-12e7-44ec-82c2-cfa32e5e01a5 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.998s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:54:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:54:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:55:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:55:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:55:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:55:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:05 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'flavor' on Instance uuid cab14831-868c-40aa-b694-9e0185557653 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:05 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:55:05 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:06 user nova-compute[71308]: INFO nova.compute.manager [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Attaching volume e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 to /dev/vdb
Apr 14 18:55:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG os_brick.utils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fac42c-dd32-45ef-b2d8-cb8c3b5287f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cf9254-c2dd-4ea3-b549-ece6087c1718]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95a11e-4d91-4218-8b7b-0515c53d8202]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13c1ee4-75d6-4953-84a6-2d1b5c79744d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:55:06 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb3c70-61c8-4cd1-8560-b908bacfbb63]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG os_brick.utils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Updating existing volume attachment record: 1ea3f2b2-478e-4e10-8d75-aa5e59928782 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:09 user nova-compute[71308]: INFO nova.compute.manager [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Rescuing
Apr 14 18:55:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquired lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG nova.network.neutron [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:55:09 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:09 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:09 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7705MB free_disk=26.281421661376953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Applying migration context for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be as it has an incoming, in-progress migration d3b949eb-76a1-4e9b-86ed-14f3dd853313. Migration status is finished {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 18:55:10 user nova-compute[71308]: INFO nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating resource usage from migration d3b949eb-76a1-4e9b-86ed-14f3dd853313
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cab14831-868c-40aa-b694-9e0185557653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Migration d3b949eb-76a1-4e9b-86ed-14f3dd853313 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.network.neutron [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updating instance_info_cache with network_info: [{"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Releasing lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-unplugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-unplugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:10 user nova-compute[71308]: WARNING nova.compute.manager [req-e1fa9b86-2aec-404b-98dc-e2da74d763e5 req-0414983c-8d1f-4970-8178-f44cc2187ff4 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-unplugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state active and task_state rescuing.
Apr 14 18:55:11 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Instance destroyed successfully.
Apr 14 18:55:11 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Attempting rescue
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71308) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Instance directory exists: not creating {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 18:55:11 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Creating image(s)
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.rescue {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.rescue" returned: 0 in 0.055s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'migration_context' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Start _get_guest_xml network_info=[{"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "vif_mac": "fa:16:3e:de:75:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'resources' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'numa_topology' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:11 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:11 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2104481497',display_name='tempest-ServerRescueNegativeTestJSON-server-2104481497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2104481497',id=16,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-8u3ne6pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:50:33Z,user_data=None,user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=1d305ab4-1813-4728-a01c-287e521a05ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "vif_mac": "fa:16:3e:de:75:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "vif_mac": "fa:16:3e:de:75:e0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=d07ff847-3983-4b35-af36-fbd845ede770,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07ff847-39') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFyDGKNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:55:11 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:55:11 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:55:11 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:55:11 user nova-compute[71308]:   <uuid>1d305ab4-1813-4728-a01c-287e521a05ec</uuid>
Apr 14 18:55:11 user nova-compute[71308]:   <name>instance-00000010</name>
Apr 14 18:55:11 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:55:11 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:55:11 user nova-compute[71308]:   <metadata>
Apr 14 18:55:11 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:55:11 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:55:11 user nova-compute[71308]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2104481497</nova:name>
Apr 14 18:55:11 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:55:11</nova:creationTime>
Apr 14 18:55:11 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:55:11 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:55:11 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:55:11 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:55:11 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:55:11 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:55:11 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:55:11 user nova-compute[71308]:       <nova:owner>
Apr 14 18:55:11 user nova-compute[71308]:         <nova:user uuid="c8713ed85ffb4446847f5ded4bc2e399">tempest-ServerRescueNegativeTestJSON-1174646715-project-member</nova:user>
Apr 14 18:55:11 user nova-compute[71308]:         <nova:project uuid="e60e8abd123e414f847c68ba72894689">tempest-ServerRescueNegativeTestJSON-1174646715</nova:project>
Apr 14 18:55:11 user nova-compute[71308]:       </nova:owner>
Apr 14 18:55:11 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:55:11 user nova-compute[71308]:       <nova:ports>
Apr 14 18:55:11 user nova-compute[71308]:         <nova:port uuid="d07ff847-3983-4b35-af36-fbd845ede770">
Apr 14 18:55:11 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 18:55:11 user nova-compute[71308]:         </nova:port>
Apr 14 18:55:11 user nova-compute[71308]:       </nova:ports>
Apr 14 18:55:11 user nova-compute[71308]:     </nova:instance>
Apr 14 18:55:11 user nova-compute[71308]:   </metadata>
Apr 14 18:55:11 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:55:11 user nova-compute[71308]:     <system>
Apr 14 18:55:11 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:55:11 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:55:11 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:55:11 user nova-compute[71308]:       <entry name="serial">1d305ab4-1813-4728-a01c-287e521a05ec</entry>
Apr 14 18:55:11 user nova-compute[71308]:       <entry name="uuid">1d305ab4-1813-4728-a01c-287e521a05ec</entry>
Apr 14 18:55:11 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:55:11 user nova-compute[71308]:     </system>
Apr 14 18:55:11 user nova-compute[71308]:   </sysinfo>
Apr 14 18:55:11 user nova-compute[71308]:   <os>
Apr 14 18:55:11 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:55:11 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:55:11 user nova-compute[71308]:   </os>
Apr 14 18:55:11 user nova-compute[71308]:   <features>
Apr 14 18:55:11 user nova-compute[71308]:     <acpi/>
Apr 14 18:55:11 user nova-compute[71308]:     <apic/>
Apr 14 18:55:11 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:55:11 user nova-compute[71308]:   </features>
Apr 14 18:55:11 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:55:11 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:55:11 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:55:11 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:55:11 user nova-compute[71308]:   </clock>
Apr 14 18:55:11 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:55:11 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:55:11 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:55:11 user nova-compute[71308]:   </cpu>
Apr 14 18:55:11 user nova-compute[71308]:   <devices>
Apr 14 18:55:11 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:55:11 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:55:11 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.rescue"/>
Apr 14 18:55:11 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:55:11 user nova-compute[71308]:     </disk>
Apr 14 18:55:11 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:55:11 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:55:11 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk"/>
Apr 14 18:55:11 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:55:11 user nova-compute[71308]:     </disk>
Apr 14 18:55:11 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:55:11 user nova-compute[71308]:       <mac address="fa:16:3e:de:75:e0"/>
Apr 14 18:55:11 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:11 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:55:11 user nova-compute[71308]:       <target dev="tapd07ff847-39"/>
Apr 14 18:55:11 user nova-compute[71308]:     </interface>
Apr 14 18:55:11 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:55:11 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/console.log" append="off"/>
Apr 14 18:55:11 user nova-compute[71308]:     </serial>
Apr 14 18:55:11 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:55:11 user nova-compute[71308]:     <video>
Apr 14 18:55:11 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:11 user nova-compute[71308]:     </video>
Apr 14 18:55:11 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:55:11 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:55:11 user nova-compute[71308]:     </rng>
Apr 14 18:55:11 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:55:11 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:55:11 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:55:11 user nova-compute[71308]:     </memballoon>
Apr 14 18:55:11 user nova-compute[71308]:   </devices>
Apr 14 18:55:11 user nova-compute[71308]: </domain>
Apr 14 18:55:11 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Instance destroyed successfully.
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c8aa24-759b-4292-bc60-bb70d7f81482]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:55:11 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec88d5-642c-4efe-99b9-e3121d256576]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7] added
Apr 14 18:55:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e9a517-d3c6-479d-ac59-e254d4ca9a8e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No VIF found with MAC fa:16:3e:de:75:e0, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b105818-4814-42a8-9044-515333d6c218]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFyDGKNx {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFyDGKNx" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42d1779-80fe-486f-adb4-5a76bb41e782]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SFyDGKNx'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[980efec9-2e43-4628-b7de-9e1437ffd673]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0055b5e9-c94c-4c38-b204-6da3893d0078]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d218e4-7a38-4524-bd73-51a7525a76bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7, portal: 172.16.0.220,3260]
Apr 14 18:55:11 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7, portal: 172.16.0.220,3260] successful.
Apr 14 18:55:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3ff86a-bd5a-4ce9-82be-f1eb213d8beb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a50cd3e-1ba4-49b9-aca3-1cf8438dc379]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:11 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f9814-d0c3-48c3-afa9-6ce878ff9d1d]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:55:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFyDGKNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:12 user nova-compute[71308]: WARNING nova.compute.manager [req-ec39c94b-9fe0-4c3d-a08f-6cea6830256f req-34086261-d28b-48c0-a068-7912897bc7c6 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state active and task_state rescuing.
Apr 14 18:55:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26536653031373339', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536653031373339', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'flavor' on Instance uuid cab14831-868c-40aa-b694-9e0185557653 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:55:12 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:55:12 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:55:12 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:55:12 user nova-compute[71308]:   <serial>e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7</serial>
Apr 14 18:55:12 user nova-compute[71308]: </disk>
Apr 14 18:55:12 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:55:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:55:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] No VIF found with MAC fa:16:3e:31:ab:a9, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:55:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f1330ae7-3bfa-4767-8d37-ab1a62131878 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.761s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:14 user nova-compute[71308]: WARNING nova.compute.manager [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state active and task_state rescuing.
Apr 14 18:55:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:14 user nova-compute[71308]: WARNING nova.compute.manager [req-a1379ef3-1124-4494-a2e4-9206b1e19c71 req-a2745a8b-4dfc-4a85-8bfa-1710da0911a2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state active and task_state rescuing.
Apr 14 18:55:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 1d305ab4-1813-4728-a01c-287e521a05ec due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:55:15 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498515.4925568, 1d305ab4-1813-4728-a01c-287e521a05ec => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:15 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] VM Resumed (Lifecycle Event)
Apr 14 18:55:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-80de3e22-3658-4c6b-a71e-a569ef1d3116 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:15 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 18:55:15 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498515.4926844, 1d305ab4-1813-4728-a01c-287e521a05ec => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:15 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] VM Started (Lifecycle Event)
Apr 14 18:55:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing instance network info cache due to event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:55:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] Acquiring lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] Acquired lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:17 user nova-compute[71308]: DEBUG nova.network.neutron [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:55:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:17 user nova-compute[71308]: DEBUG nova.network.neutron [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updated VIF entry in instance network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:55:17 user nova-compute[71308]: DEBUG nova.network.neutron [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updating instance_info_cache with network_info: [{"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-98792215-3e51-406b-a284-7293cddb5823 req-02603373-f7a6-4599-8d3d-11c418c968a7 service nova] Releasing lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing instance network info cache due to event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:55:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] Acquiring lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] Acquired lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:19 user nova-compute[71308]: DEBUG nova.network.neutron [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:55:19 user nova-compute[71308]: DEBUG nova.network.neutron [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updated VIF entry in instance network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:55:19 user nova-compute[71308]: DEBUG nova.network.neutron [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updating instance_info_cache with network_info: [{"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ead74d1-62b8-4718-9673-3ad042fc8dba req-d411cdb3-0fde-4c0d-985b-12f4a979a8f9 service nova] Releasing lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:20 user nova-compute[71308]: INFO nova.compute.manager [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Rebooting instance
Apr 14 18:55:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquired lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:20 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:55:20 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Updating instance_info_cache with network_info: [{"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Releasing lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-unplugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] No waiting events found dispatching network-vif-unplugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:23 user nova-compute[71308]: WARNING nova.compute.manager [req-d8ebdb1c-085e-4c1c-9c0f-429b14309b72 req-e8ac3171-89d1-4039-9327-94fe39922a61 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received unexpected event network-vif-unplugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance with vm_state active and task_state reboot_started.
Apr 14 18:55:23 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Instance shutdown successfully.
Apr 14 18:55:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:55:24 user nova-compute[71308]: INFO nova.compute.claims [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Claim successful on node user
Apr 14 18:55:24 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.643s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:55:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:55:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:55:24 user nova-compute[71308]: DEBUG nova.policy [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:55:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Creating image(s)
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "/opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "/opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "/opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.201s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] No waiting events found dispatching network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:25 user nova-compute[71308]: WARNING nova.compute.manager [req-ac8d2889-a4ab-4063-976f-9fb74716a17b req-83c2df61-3b3e-414d-8587-c83bf6d3f741 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received unexpected event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance with vm_state active and task_state reboot_started.
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk 1073741824" returned: 0 in 0.155s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.objects.instance [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquired lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.network.neutron [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.objects.instance [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'info_cache' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.154s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Cannot resize image /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'migration_context' on Instance uuid 1feb4399-a5dc-43a7-ac78-4d22809e2737 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Ensure instance console log exists: /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "8832a321-f1ac-411a-8fc9-1fc816bffec6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Successfully created port: 99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:55:26 user nova-compute[71308]: INFO nova.compute.claims [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Claim successful on node user
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.network.neutron [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updating instance_info_cache with network_info: [{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Releasing lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance destroyed successfully.
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.objects.instance [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'resources' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1892211249',display_name='tempest-AttachVolumeTestJSON-server-1892211249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1892211249',id=20,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA==',key_name='tempest-keypair-1957519464',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-h1jd70xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=0050e6bb-0b53-4fdc-8437-16b94ee79fa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG os_vif [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd49e6c-3f, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:55:26 user nova-compute[71308]: INFO os_vif [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f')
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpShYmcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:55:26 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:55:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbe1491-34c1-4eab-8ba4-1575cc83d962]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:55:26 user nova-compute[71308]: No targets found.
Apr 14 18:55:26 user nova-compute[71308]: iSNS:
Apr 14 18:55:26 user nova-compute[71308]: No targets found.
Apr 14 18:55:26 user nova-compute[71308]: STATIC:
Apr 14 18:55:26 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:55:26 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:55:26 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:55:26 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a
Apr 14 18:55:26 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:55:26 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:55:26 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7
Apr 14 18:55:26 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:55:26 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:55:26 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:55:26 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:55:26 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:55:26 user nova-compute[71308]: FIRMWARE:
Apr 14 18:55:26 user nova-compute[71308]: No targets found.
Apr 14 18:55:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:55:26 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:55:26 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:55:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce476f4-cf44-4166-8435-5e4b3071db2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a9dbeb-949a-4fa2-8975-d867b6086a70]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2230743010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a'): ({'sde'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Removing single pathed devices sde {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[32860a03-da30-4a96-b238-05da8780f3e2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa863fde-5ca6-434e-9346-982092661214]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flushing IO for device /dev/sde {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e6b4a0-715d-482a-9058-42175cae89b6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:55:27 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1261e-b1c5-4634-a0f4-88fe5c456671]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be974e-203b-4545-b933-39130a9f8600]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfd6f2b-d7bd-4e9c-b609-247a2eda520d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260]
Apr 14 18:55:27 user nova-compute[71308]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260] successful.
Apr 14 18:55:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:55:27 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Creating image(s)
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "/opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "/opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "/opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.policy [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '008a24026e844252b0be1268461bc2b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af68184e7654efea3187e05bb10e5e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b6b67-4fd7-4e1d-b6da-fe74bf9c449e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== disconnect_volume: return (395ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Start _get_guest_xml network_info=[{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '4ee0a3ad-03ff-4730-85ac-f404d0e6acd6', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpShYmcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0050e6bb-0b53-4fdc-8437-16b94ee79fa4', 'attached_at': '', 'detached_at': '', 'volume_id': '8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 'serial': '8870d3d7-990b-4d4c-8d7a-4591106f1a3a'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.objects.instance [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'numa_topology' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] No waiting events found dispatching network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:27 user nova-compute[71308]: WARNING nova.compute.manager [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received unexpected event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance with vm_state active and task_state reboot_started.
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] No waiting events found dispatching network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:27 user nova-compute[71308]: WARNING nova.compute.manager [req-2420df51-8c06-48d9-bdb5-47740591e722 req-8710a300-0f74-4485-81dc-01a639468aa1 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received unexpected event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance with vm_state active and task_state reboot_started.
Apr 14 18:55:27 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:27 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.objects.instance [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Successfully updated port: 99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpShYmcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:55:27 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:55:27 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:55:27 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquired lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.195s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6945f5d3-4347-4df1-a8e3-5dee6d33e878]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:55:27 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2800dc81-ffaf-4238-9951-add80249cef4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a] added
Apr 14 18:55:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab85747d-f6b0-4ca2-9e21-6f29b1c12203]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for cab14831-868c-40aa-b694-9e0185557653 due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498527.6660373, cab14831-868c-40aa-b694-9e0185557653 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:27 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] VM Resumed (Lifecycle Event)
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b5be46-b02f-4c41-8fc1-c9aa1a09426f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:27 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: cab14831-868c-40aa-b694-9e0185557653] Instance running successfully.
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpShYmcB {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Instance soft rebooted successfully.
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.168s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zpShYmcB" returned: 0 in 0.043s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2f65e6-b789-4a13-a1d9-d6758db7bbc3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zpShYmcB'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:27 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498527.6758013, cab14831-868c-40aa-b694-9e0185557653 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:27 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] VM Started (Lifecycle Event)
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk 1073741824" returned: 0 in 0.057s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85417a1-74e9-4af3-9b41-bfa5847ea1ab]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2700acd7-7a3e-4581-a10f-af390416ca08]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:27 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e0251b1b-a7ea-4554-af21-19d512d2fb15 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.870s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.155s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed8ef2f-b15e-4083-b33b-cc642c41d4ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260]
Apr 14 18:55:27 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260] successful.
Apr 14 18:55:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[41052228-3d31-438b-b27c-25f9a9aa9597]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8289dde-14aa-4d06-ae37-f300f57db24d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:28 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:28 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:28 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:28 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:28 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:28 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:28 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:28 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.515s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d01399-7175-44e4-8a5d-2f3610f5424e]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpShYmcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Cannot resize image /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lazy-loading 'migration_context' on Instance uuid 8832a321-f1ac-411a-8fc9-1fc816bffec6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Ensure instance console log exists: /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Updating instance_info_cache with network_info: [{"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Releasing lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Instance network_info: |[{"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Start _get_guest_xml network_info=[{"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:55:28 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:28 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1245634344',display_name='tempest-TestStampPattern-server-1245634344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1245634344',id=26,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx8M4QjbAb47cqa0IIK3DFtHC++DW5qjEMCJfo5EDtvaO/cl4OHImq2UJzNJC1zQSEajn+k79i0pWkmV4FFQZ3qK1iN0DjaB8oxSduo8LZXNaMWp9839OvzlCknJnwL1A==',key_name='tempest-TestStampPattern-580300982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='921435d84194431c886ec1ed1848d4d6',ramdisk_id='',reservation_id='r-24tjymju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-251531447',owner_user_name='tempest-TestStampPattern-251531447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:55:25Z,user_data=None,user_id='9a9414d0c24643fdb162aad828c736bd',uuid=1feb4399-a5dc-43a7-ac78-4d22809e2737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converting VIF {"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:b8:29,bridge_name='br-int',has_traffic_filtering=True,id=99fafc78-521b-4f9c-81fe-9571483238c1,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99fafc78-52') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'pci_devices' on Instance uuid 1feb4399-a5dc-43a7-ac78-4d22809e2737 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.network.neutron [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Successfully created port: e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:55:28 user nova-compute[71308]:   <uuid>1feb4399-a5dc-43a7-ac78-4d22809e2737</uuid>
Apr 14 18:55:28 user nova-compute[71308]:   <name>instance-0000001a</name>
Apr 14 18:55:28 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:55:28 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:55:28 user nova-compute[71308]:   <metadata>
Apr 14 18:55:28 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:55:28 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:55:28 user nova-compute[71308]:       <nova:name>tempest-TestStampPattern-server-1245634344</nova:name>
Apr 14 18:55:28 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:55:28</nova:creationTime>
Apr 14 18:55:28 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:55:28 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:55:28 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:55:28 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:55:28 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:55:28 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:55:28 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:55:28 user nova-compute[71308]:       <nova:owner>
Apr 14 18:55:28 user nova-compute[71308]:         <nova:user uuid="9a9414d0c24643fdb162aad828c736bd">tempest-TestStampPattern-251531447-project-member</nova:user>
Apr 14 18:55:28 user nova-compute[71308]:         <nova:project uuid="921435d84194431c886ec1ed1848d4d6">tempest-TestStampPattern-251531447</nova:project>
Apr 14 18:55:28 user nova-compute[71308]:       </nova:owner>
Apr 14 18:55:28 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:55:28 user nova-compute[71308]:       <nova:ports>
Apr 14 18:55:28 user nova-compute[71308]:         <nova:port uuid="99fafc78-521b-4f9c-81fe-9571483238c1">
Apr 14 18:55:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 18:55:28 user nova-compute[71308]:         </nova:port>
Apr 14 18:55:28 user nova-compute[71308]:       </nova:ports>
Apr 14 18:55:28 user nova-compute[71308]:     </nova:instance>
Apr 14 18:55:28 user nova-compute[71308]:   </metadata>
Apr 14 18:55:28 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:55:28 user nova-compute[71308]:     <system>
Apr 14 18:55:28 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:55:28 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:55:28 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:55:28 user nova-compute[71308]:       <entry name="serial">1feb4399-a5dc-43a7-ac78-4d22809e2737</entry>
Apr 14 18:55:28 user nova-compute[71308]:       <entry name="uuid">1feb4399-a5dc-43a7-ac78-4d22809e2737</entry>
Apr 14 18:55:28 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:55:28 user nova-compute[71308]:     </system>
Apr 14 18:55:28 user nova-compute[71308]:   </sysinfo>
Apr 14 18:55:28 user nova-compute[71308]:   <os>
Apr 14 18:55:28 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:55:28 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:55:28 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:55:28 user nova-compute[71308]:   </os>
Apr 14 18:55:28 user nova-compute[71308]:   <features>
Apr 14 18:55:28 user nova-compute[71308]:     <acpi/>
Apr 14 18:55:28 user nova-compute[71308]:     <apic/>
Apr 14 18:55:28 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:55:28 user nova-compute[71308]:   </features>
Apr 14 18:55:28 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:55:28 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:55:28 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:55:28 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:55:28 user nova-compute[71308]:   </clock>
Apr 14 18:55:28 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:55:28 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:55:28 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:55:28 user nova-compute[71308]:   </cpu>
Apr 14 18:55:28 user nova-compute[71308]:   <devices>
Apr 14 18:55:28 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:55:28 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:55:28 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk"/>
Apr 14 18:55:28 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:55:28 user nova-compute[71308]:     </disk>
Apr 14 18:55:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:55:28 user nova-compute[71308]:       <mac address="fa:16:3e:be:b8:29"/>
Apr 14 18:55:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:55:28 user nova-compute[71308]:       <target dev="tap99fafc78-52"/>
Apr 14 18:55:28 user nova-compute[71308]:     </interface>
Apr 14 18:55:28 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:55:28 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/console.log" append="off"/>
Apr 14 18:55:28 user nova-compute[71308]:     </serial>
Apr 14 18:55:28 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:55:28 user nova-compute[71308]:     <video>
Apr 14 18:55:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:28 user nova-compute[71308]:     </video>
Apr 14 18:55:28 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:55:28 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:55:28 user nova-compute[71308]:     </rng>
Apr 14 18:55:28 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:55:28 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:55:28 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:55:28 user nova-compute[71308]:     </memballoon>
Apr 14 18:55:28 user nova-compute[71308]:   </devices>
Apr 14 18:55:28 user nova-compute[71308]: </domain>
Apr 14 18:55:28 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1245634344',display_name='tempest-TestStampPattern-server-1245634344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1245634344',id=26,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx8M4QjbAb47cqa0IIK3DFtHC++DW5qjEMCJfo5EDtvaO/cl4OHImq2UJzNJC1zQSEajn+k79i0pWkmV4FFQZ3qK1iN0DjaB8oxSduo8LZXNaMWp9839OvzlCknJnwL1A==',key_name='tempest-TestStampPattern-580300982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='921435d84194431c886ec1ed1848d4d6',ramdisk_id='',reservation_id='r-24tjymju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-251531447',owner_user_name='tempest-TestStampPattern-251531447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:55:25Z,user_data=None,user_id='9a9414d0c24643fdb162aad828c736bd',uuid=1feb4399-a5dc-43a7-ac78-4d22809e2737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converting VIF {"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:b8:29,bridge_name='br-int',has_traffic_filtering=True,id=99fafc78-521b-4f9c-81fe-9571483238c1,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99fafc78-52') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG os_vif [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b8:29,bridge_name='br-int',has_traffic_filtering=True,id=99fafc78-521b-4f9c-81fe-9571483238c1,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99fafc78-52') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99fafc78-52, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99fafc78-52, col_values=(('external_ids', {'iface-id': '99fafc78-521b-4f9c-81fe-9571483238c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:b8:29', 'vm-uuid': '1feb4399-a5dc-43a7-ac78-4d22809e2737'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:28 user nova-compute[71308]: INFO os_vif [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:b8:29,bridge_name='br-int',has_traffic_filtering=True,id=99fafc78-521b-4f9c-81fe-9571483238c1,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99fafc78-52')
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:55:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No VIF found with MAC fa:16:3e:be:b8:29, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.554s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== connect_volume: return (1556ms) {'type': 'block', 'scsi_wwn': '26636386334386233', 'path': '/dev/sde'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636386334386233', 'path': '/dev/sde'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1892211249',display_name='tempest-AttachVolumeTestJSON-server-1892211249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1892211249',id=20,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA==',key_name='tempest-keypair-1957519464',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-h1jd70xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=0050e6bb-0b53-4fdc-8437-16b94ee79fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'pci_devices' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:55:29 user nova-compute[71308]:   <uuid>0050e6bb-0b53-4fdc-8437-16b94ee79fa4</uuid>
Apr 14 18:55:29 user nova-compute[71308]:   <name>instance-00000014</name>
Apr 14 18:55:29 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:55:29 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:55:29 user nova-compute[71308]:   <metadata>
Apr 14 18:55:29 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:55:29 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:55:29 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeTestJSON-server-1892211249</nova:name>
Apr 14 18:55:29 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:55:27</nova:creationTime>
Apr 14 18:55:29 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:55:29 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:55:29 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:55:29 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:55:29 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:55:29 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:55:29 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:55:29 user nova-compute[71308]:       <nova:owner>
Apr 14 18:55:29 user nova-compute[71308]:         <nova:user uuid="9f90c8f23e3b42a98fdb9261db65f547">tempest-AttachVolumeTestJSON-1126291015-project-member</nova:user>
Apr 14 18:55:29 user nova-compute[71308]:         <nova:project uuid="edf25bcc0dea4d3eb1284e8995eb3466">tempest-AttachVolumeTestJSON-1126291015</nova:project>
Apr 14 18:55:29 user nova-compute[71308]:       </nova:owner>
Apr 14 18:55:29 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:55:29 user nova-compute[71308]:       <nova:ports>
Apr 14 18:55:29 user nova-compute[71308]:         <nova:port uuid="2dd49e6c-3f3a-4124-aff8-a4a4e898cf21">
Apr 14 18:55:29 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 18:55:29 user nova-compute[71308]:         </nova:port>
Apr 14 18:55:29 user nova-compute[71308]:       </nova:ports>
Apr 14 18:55:29 user nova-compute[71308]:     </nova:instance>
Apr 14 18:55:29 user nova-compute[71308]:   </metadata>
Apr 14 18:55:29 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:55:29 user nova-compute[71308]:     <system>
Apr 14 18:55:29 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:55:29 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:55:29 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:55:29 user nova-compute[71308]:       <entry name="serial">0050e6bb-0b53-4fdc-8437-16b94ee79fa4</entry>
Apr 14 18:55:29 user nova-compute[71308]:       <entry name="uuid">0050e6bb-0b53-4fdc-8437-16b94ee79fa4</entry>
Apr 14 18:55:29 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:55:29 user nova-compute[71308]:     </system>
Apr 14 18:55:29 user nova-compute[71308]:   </sysinfo>
Apr 14 18:55:29 user nova-compute[71308]:   <os>
Apr 14 18:55:29 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:55:29 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:55:29 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:55:29 user nova-compute[71308]:   </os>
Apr 14 18:55:29 user nova-compute[71308]:   <features>
Apr 14 18:55:29 user nova-compute[71308]:     <acpi/>
Apr 14 18:55:29 user nova-compute[71308]:     <apic/>
Apr 14 18:55:29 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:55:29 user nova-compute[71308]:   </features>
Apr 14 18:55:29 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:55:29 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:55:29 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:55:29 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:55:29 user nova-compute[71308]:   </clock>
Apr 14 18:55:29 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:55:29 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:55:29 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:55:29 user nova-compute[71308]:   </cpu>
Apr 14 18:55:29 user nova-compute[71308]:   <devices>
Apr 14 18:55:29 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:55:29 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:55:29 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk"/>
Apr 14 18:55:29 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:55:29 user nova-compute[71308]:     </disk>
Apr 14 18:55:29 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:55:29 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:55:29 user nova-compute[71308]:       <source dev="/dev/sde"/>
Apr 14 18:55:29 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:55:29 user nova-compute[71308]:       <serial>8870d3d7-990b-4d4c-8d7a-4591106f1a3a</serial>
Apr 14 18:55:29 user nova-compute[71308]:     </disk>
Apr 14 18:55:29 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:55:29 user nova-compute[71308]:       <mac address="fa:16:3e:18:06:fd"/>
Apr 14 18:55:29 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:29 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:55:29 user nova-compute[71308]:       <target dev="tap2dd49e6c-3f"/>
Apr 14 18:55:29 user nova-compute[71308]:     </interface>
Apr 14 18:55:29 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:55:29 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/console.log" append="off"/>
Apr 14 18:55:29 user nova-compute[71308]:     </serial>
Apr 14 18:55:29 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:55:29 user nova-compute[71308]:     <video>
Apr 14 18:55:29 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:29 user nova-compute[71308]:     </video>
Apr 14 18:55:29 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:55:29 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:55:29 user nova-compute[71308]:     </rng>
Apr 14 18:55:29 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:55:29 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:55:29 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:55:29 user nova-compute[71308]:     </memballoon>
Apr 14 18:55:29 user nova-compute[71308]:   </devices>
Apr 14 18:55:29 user nova-compute[71308]: </domain>
Apr 14 18:55:29 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-changed-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Refreshing instance network info cache due to event network-changed-99fafc78-521b-4f9c-81fe-9571483238c1. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] Acquiring lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] Acquired lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Refreshing network info cache for port 99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Cannot resize image /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'migration_context' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1892211249',display_name='tempest-AttachVolumeTestJSON-server-1892211249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1892211249',id=20,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA==',key_name='tempest-keypair-1957519464',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-h1jd70xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=0050e6bb-0b53-4fdc-8437-16b94ee79fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG os_vif [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd49e6c-3f, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dd49e6c-3f, col_values=(('external_ids', {'iface-id': '2dd49e6c-3f3a-4124-aff8-a4a4e898cf21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:06:fd', 'vm-uuid': '0050e6bb-0b53-4fdc-8437-16b94ee79fa4'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:55:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:29 user nova-compute[71308]: INFO os_vif [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f')
Apr 14 18:55:30 user nova-compute[71308]: DEBUG nova.network.neutron [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Successfully updated port: e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "refresh_cache-8832a321-f1ac-411a-8fc9-1fc816bffec6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquired lock "refresh_cache-8832a321-f1ac-411a-8fc9-1fc816bffec6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG nova.network.neutron [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG nova.network.neutron [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG nova.network.neutron [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Updated VIF entry in instance network info cache for port 99fafc78-521b-4f9c-81fe-9571483238c1. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG nova.network.neutron [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Updating instance_info_cache with network_info: [{"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ce6a9714-047c-4db2-a441-918188ef4ecc req-ca99f5e4-05ce-438f-a9a0-3f0666f8d45e service nova] Releasing lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.network.neutron [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Updating instance_info_cache with network_info: [{"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Releasing lock "refresh_cache-8832a321-f1ac-411a-8fc9-1fc816bffec6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Instance network_info: |[{"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Start _get_guest_xml network_info=[{"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:55:31 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:31 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-346421927',display_name='tempest-ServersNegativeTestJSON-server-346421927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-346421927',id=27,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af68184e7654efea3187e05bb10e5e4',ramdisk_id='',reservation_id='r-jrce2kh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1532814906',owner_user_name='tempest-ServersNegativeTestJSON-1532814906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:55:27Z,user_data=None,user_id='008a24026e844252b0be1268461bc2b1',uuid=8832a321-f1ac-411a-8fc9-1fc816bffec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converting VIF {"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=e4886e4d-4e50-4de8-93e6-61be10466add,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4886e4d-4e') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.objects.instance [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lazy-loading 'pci_devices' on Instance uuid 8832a321-f1ac-411a-8fc9-1fc816bffec6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:55:31 user nova-compute[71308]:   <uuid>8832a321-f1ac-411a-8fc9-1fc816bffec6</uuid>
Apr 14 18:55:31 user nova-compute[71308]:   <name>instance-0000001b</name>
Apr 14 18:55:31 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:55:31 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:55:31 user nova-compute[71308]:   <metadata>
Apr 14 18:55:31 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:55:31 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:55:31 user nova-compute[71308]:       <nova:name>tempest-ServersNegativeTestJSON-server-346421927</nova:name>
Apr 14 18:55:31 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:55:31</nova:creationTime>
Apr 14 18:55:31 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:55:31 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:55:31 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:55:31 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:55:31 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:55:31 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:55:31 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:55:31 user nova-compute[71308]:       <nova:owner>
Apr 14 18:55:31 user nova-compute[71308]:         <nova:user uuid="008a24026e844252b0be1268461bc2b1">tempest-ServersNegativeTestJSON-1532814906-project-member</nova:user>
Apr 14 18:55:31 user nova-compute[71308]:         <nova:project uuid="4af68184e7654efea3187e05bb10e5e4">tempest-ServersNegativeTestJSON-1532814906</nova:project>
Apr 14 18:55:31 user nova-compute[71308]:       </nova:owner>
Apr 14 18:55:31 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:55:31 user nova-compute[71308]:       <nova:ports>
Apr 14 18:55:31 user nova-compute[71308]:         <nova:port uuid="e4886e4d-4e50-4de8-93e6-61be10466add">
Apr 14 18:55:31 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 18:55:31 user nova-compute[71308]:         </nova:port>
Apr 14 18:55:31 user nova-compute[71308]:       </nova:ports>
Apr 14 18:55:31 user nova-compute[71308]:     </nova:instance>
Apr 14 18:55:31 user nova-compute[71308]:   </metadata>
Apr 14 18:55:31 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:55:31 user nova-compute[71308]:     <system>
Apr 14 18:55:31 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:55:31 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:55:31 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:55:31 user nova-compute[71308]:       <entry name="serial">8832a321-f1ac-411a-8fc9-1fc816bffec6</entry>
Apr 14 18:55:31 user nova-compute[71308]:       <entry name="uuid">8832a321-f1ac-411a-8fc9-1fc816bffec6</entry>
Apr 14 18:55:31 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:55:31 user nova-compute[71308]:     </system>
Apr 14 18:55:31 user nova-compute[71308]:   </sysinfo>
Apr 14 18:55:31 user nova-compute[71308]:   <os>
Apr 14 18:55:31 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:55:31 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:55:31 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:55:31 user nova-compute[71308]:   </os>
Apr 14 18:55:31 user nova-compute[71308]:   <features>
Apr 14 18:55:31 user nova-compute[71308]:     <acpi/>
Apr 14 18:55:31 user nova-compute[71308]:     <apic/>
Apr 14 18:55:31 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:55:31 user nova-compute[71308]:   </features>
Apr 14 18:55:31 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:55:31 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:55:31 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:55:31 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:55:31 user nova-compute[71308]:   </clock>
Apr 14 18:55:31 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:55:31 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:55:31 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:55:31 user nova-compute[71308]:   </cpu>
Apr 14 18:55:31 user nova-compute[71308]:   <devices>
Apr 14 18:55:31 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:55:31 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:55:31 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk"/>
Apr 14 18:55:31 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:55:31 user nova-compute[71308]:     </disk>
Apr 14 18:55:31 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:55:31 user nova-compute[71308]:       <mac address="fa:16:3e:03:2c:72"/>
Apr 14 18:55:31 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:31 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:55:31 user nova-compute[71308]:       <target dev="tape4886e4d-4e"/>
Apr 14 18:55:31 user nova-compute[71308]:     </interface>
Apr 14 18:55:31 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:55:31 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/console.log" append="off"/>
Apr 14 18:55:31 user nova-compute[71308]:     </serial>
Apr 14 18:55:31 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:55:31 user nova-compute[71308]:     <video>
Apr 14 18:55:31 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:31 user nova-compute[71308]:     </video>
Apr 14 18:55:31 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:55:31 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:55:31 user nova-compute[71308]:     </rng>
Apr 14 18:55:31 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:55:31 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:55:31 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:55:31 user nova-compute[71308]:     </memballoon>
Apr 14 18:55:31 user nova-compute[71308]:   </devices>
Apr 14 18:55:31 user nova-compute[71308]: </domain>
Apr 14 18:55:31 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-346421927',display_name='tempest-ServersNegativeTestJSON-server-346421927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-346421927',id=27,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4af68184e7654efea3187e05bb10e5e4',ramdisk_id='',reservation_id='r-jrce2kh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1532814906',owner_user_name='tempest-ServersNegativeTestJSON-1532814906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:55:27Z,user_data=None,user_id='008a24026e844252b0be1268461bc2b1',uuid=8832a321-f1ac-411a-8fc9-1fc816bffec6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converting VIF {"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=e4886e4d-4e50-4de8-93e6-61be10466add,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4886e4d-4e') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG os_vif [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=e4886e4d-4e50-4de8-93e6-61be10466add,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4886e4d-4e') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4886e4d-4e, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4886e4d-4e, col_values=(('external_ids', {'iface-id': 'e4886e4d-4e50-4de8-93e6-61be10466add', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:2c:72', 'vm-uuid': '8832a321-f1ac-411a-8fc9-1fc816bffec6'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:31 user nova-compute[71308]: INFO os_vif [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=e4886e4d-4e50-4de8-93e6-61be10466add,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4886e4d-4e')
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received event network-changed-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Refreshing instance network info cache due to event network-changed-e4886e4d-4e50-4de8-93e6-61be10466add. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Acquiring lock "refresh_cache-8832a321-f1ac-411a-8fc9-1fc816bffec6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Acquired lock "refresh_cache-8832a321-f1ac-411a-8fc9-1fc816bffec6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.network.neutron [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Refreshing network info cache for port e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:55:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] No VIF found with MAC fa:16:3e:03:2c:72, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:32 user nova-compute[71308]: WARNING nova.compute.manager [req-8463c6c0-2ae1-4099-b0ac-4d0c02478cff req-6cbe8eb7-f8d0-449b-aca5-713956da339c service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state stopped and task_state powering-on.
Apr 14 18:55:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG nova.network.neutron [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Updated VIF entry in instance network info cache for port e4886e4d-4e50-4de8-93e6-61be10466add. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG nova.network.neutron [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Updating instance_info_cache with network_info: [{"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Releasing lock "refresh_cache-8832a321-f1ac-411a-8fc9-1fc816bffec6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] No waiting events found dispatching network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:33 user nova-compute[71308]: WARNING nova.compute.manager [req-b5bd8919-91b5-40d2-b956-f0b8b9821d26 req-72a7f307-727d-470a-a799-feee0853e33d service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received unexpected event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 for instance with vm_state building and task_state spawning.
Apr 14 18:55:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] No waiting events found dispatching network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:33 user nova-compute[71308]: WARNING nova.compute.manager [req-63b4b5a1-6df0-45a5-8c5d-7df43e148185 req-1f01585d-54fd-4e13-967b-e833e8aec198 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received unexpected event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 for instance with vm_state building and task_state spawning.
Apr 14 18:55:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:33 user nova-compute[71308]: INFO nova.compute.manager [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Unshelving
Apr 14 18:55:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:33 user nova-compute[71308]: INFO nova.virt.block_device [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Booting with volume bbbfd96c-e671-4f85-8956-985a620429f4 at /dev/vda
Apr 14 18:55:34 user nova-compute[71308]: DEBUG os_brick.utils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a34cb4-0a94-4c5c-b55a-70c70f0eae14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[14174366-f9d4-4f6d-a2d8-1000551b2785]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba11a3af-2393-40c2-82f4-65ac4392f204]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebe12bf-90b6-4fe5-9203-2242a0f127b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:55:34 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[595eef5d-3a57-48c9-aa24-601eb7848362]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG os_brick.utils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating existing volume attachment record: 2122494a-acd6-4400-bdd5-0cdb8be27468 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:34 user nova-compute[71308]: WARNING nova.compute.manager [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state stopped and task_state powering-on.
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received event network-vif-plugged-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Acquiring lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] No waiting events found dispatching network-vif-plugged-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:34 user nova-compute[71308]: WARNING nova.compute.manager [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received unexpected event network-vif-plugged-e4886e4d-4e50-4de8-93e6-61be10466add for instance with vm_state building and task_state spawning.
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received event network-vif-plugged-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Acquiring lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] No waiting events found dispatching network-vif-plugged-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:34 user nova-compute[71308]: WARNING nova.compute.manager [req-248b781f-89e7-4b0c-816d-94100082d0ae req-bd66cbed-8be4-4ba0-8a32-8666298537a4 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received unexpected event network-vif-plugged-e4886e4d-4e50-4de8-93e6-61be10466add for instance with vm_state building and task_state spawning.
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498534.622239, 1feb4399-a5dc-43a7-ac78-4d22809e2737 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:34 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] VM Resumed (Lifecycle Event)
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:34 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Instance spawned successfully.
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:34 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498534.6227603, 1feb4399-a5dc-43a7-ac78-4d22809e2737 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:34 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] VM Started (Lifecycle Event)
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:34 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:55:34 user nova-compute[71308]: INFO nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Took 9.78 seconds to spawn the instance on the hypervisor.
Apr 14 18:55:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:34 user nova-compute[71308]: INFO nova.compute.manager [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Took 10.86 seconds to build instance.
Apr 14 18:55:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ffa11efd-ffd4-4f20-94d8-fdb54dfb60fb tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.021s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498536.1957643, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] VM Resumed (Lifecycle Event)
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance rebooted successfully.
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-032ab8ad-59a5-4b7d-a69b-098f453a3bcd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498536.2018552, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] VM Started (Lifecycle Event)
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498536.7066777, 8832a321-f1ac-411a-8fc9-1fc816bffec6 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] VM Resumed (Lifecycle Event)
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Instance spawned successfully.
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498536.7290757, 8832a321-f1ac-411a-8fc9-1fc816bffec6 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] VM Started (Lifecycle Event)
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:55:36 user nova-compute[71308]: INFO nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Took 9.63 seconds to spawn the instance on the hypervisor.
Apr 14 18:55:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:37 user nova-compute[71308]: INFO nova.compute.manager [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Took 10.74 seconds to build instance.
Apr 14 18:55:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-68cf0e79-a712-4cae-b15d-334bca4b9b29 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.851s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:40 user nova-compute[71308]: INFO nova.compute.manager [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Terminating instance
Apr 14 18:55:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received event network-vif-unplugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] No waiting events found dispatching network-vif-unplugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-cbd4cc27-f13c-4124-95fd-9d7072211d81 req-eec8d95b-6a48-4882-9f9f-8384d8890042 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received event network-vif-unplugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG nova.objects.instance [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lazy-loading 'pci_requests' on Instance uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG nova.objects.instance [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lazy-loading 'numa_topology' on Instance uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:40 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:55:40 user nova-compute[71308]: INFO nova.compute.claims [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Claim successful on node user
Apr 14 18:55:41 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Instance destroyed successfully.
Apr 14 18:55:41 user nova-compute[71308]: DEBUG nova.objects.instance [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'resources' on Instance uuid 61944d61-738b-42a7-a95d-8caa6fa29a38 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-392017485',display_name='tempest-AttachVolumeNegativeTest-server-392017485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-392017485',id=22,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBdTHH0H6VXNnMYimnSG4KckCVTwmifHZuurimvpTfWYb4mgJKyCtQIabvc1PZ8V26HhS8h70WozUX1N4eA51ipk4XibhZWDpmGlM6sre8QIwBcSpKz+aM7zxlomNBtFw==',key_name='tempest-keypair-1273846851',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:52:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-ocyjbqwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:52:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=61944d61-738b-42a7-a95d-8caa6fa29a38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "address": "fa:16:3e:d7:78:30", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d648bd-cf", "ovs_interfaceid": "62d648bd-cf77-401d-abcf-b4f95e339dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:78:30,bridge_name='br-int',has_traffic_filtering=True,id=62d648bd-cf77-401d-abcf-b4f95e339dc9,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d648bd-cf') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG os_vif [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:78:30,bridge_name='br-int',has_traffic_filtering=True,id=62d648bd-cf77-401d-abcf-b4f95e339dc9,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d648bd-cf') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62d648bd-cf, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:55:41 user nova-compute[71308]: INFO os_vif [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:78:30,bridge_name='br-int',has_traffic_filtering=True,id=62d648bd-cf77-401d-abcf-b4f95e339dc9,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d648bd-cf')
Apr 14 18:55:41 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Deleting instance files /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38_del
Apr 14 18:55:41 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Deletion of /opt/stack/data/nova/instances/61944d61-738b-42a7-a95d-8caa6fa29a38_del complete
Apr 14 18:55:41 user nova-compute[71308]: INFO nova.compute.manager [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 14 18:55:41 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:55:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.833s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:41 user nova-compute[71308]: INFO nova.network.neutron [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 18:55:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received event network-vif-plugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] Acquiring lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] No waiting events found dispatching network-vif-plugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:42 user nova-compute[71308]: WARNING nova.compute.manager [req-08d29349-3fc0-42b9-a5bc-34350c9fbb0c req-3aa0e127-5e39-45fd-adab-367f1360d8fa service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received unexpected event network-vif-plugged-62d648bd-cf77-401d-abcf-b4f95e339dc9 for instance with vm_state active and task_state deleting.
Apr 14 18:55:42 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquired lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.network.neutron [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Received event network-vif-deleted-62d648bd-cf77-401d-abcf-b4f95e339dc9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:43 user nova-compute[71308]: INFO nova.compute.manager [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Neutron deleted interface 62d648bd-cf77-401d-abcf-b4f95e339dc9; detaching it from the instance and deleting it from the info cache
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.network.neutron [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:43 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Took 2.16 seconds to deallocate network for instance.
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-386212ca-8fec-449c-a7fd-ab4c457d9d6b req-64605975-d849-47e0-a22e-0391213d4257 service nova] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Detach interface failed, port_id=62d648bd-cf77-401d-abcf-b4f95e339dc9, reason: Instance 61944d61-738b-42a7-a95d-8caa6fa29a38 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.network.neutron [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:43 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Deleted allocations for instance 61944d61-738b-42a7-a95d-8caa6fa29a38
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Releasing lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:55:43 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Creating image(s)
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Ensure instance console log exists: /opt/stack/data/nova/instances/a2a860bd-802f-4760-b77b-92b7ac4ad09b/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Start _get_guest_xml network_info=[{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '2122494a-acd6-4400-bdd5-0cdb8be27468', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWzfbaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a2a860bd-802f-4760-b77b-92b7ac4ad09b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bbbfd96c-e671-4f85-8956-985a620429f4', 'serial': 'bbbfd96c-e671-4f85-8956-985a620429f4'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:55:43 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:43 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.objects.instance [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lazy-loading 'vcpu_model' on Instance uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWzfbaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:55:43 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:55:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:55:43 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:55:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:55:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:55:43 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:55:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85dc4736-cf02-434a-a694-eb2fd41eb77c tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "61944d61-738b-42a7-a95d-8caa6fa29a38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.884s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c4dc5-5519-4c0e-879d-fce682f3fc22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:55:44 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9766808-90d2-4290-8201-f1bb3da29e33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4] added
Apr 14 18:55:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[699fecd2-f87d-4be1-8db3-a58640f5fd14]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16b805-b16c-43b9-bc98-06d1a9af83fe]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkWzfbaw {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkWzfbaw" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b717dd2-1b51-4cda-a822-092d09cf83be]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lkWzfbaw'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa06f67-dac7-4099-8881-37f2e1cc8727]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31319c7-fd7e-452d-87fb-13afe9bd4ee7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a9c372-9fa6-4eb0-931e-e87a91a5c618]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260]
Apr 14 18:55:44 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260] successful.
Apr 14 18:55:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[522f5ab3-c1e6-425f-a206-a1c605cd30d4]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21af194-8d2e-42dc-b4e0-21951df73813]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:55:44 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:55:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.473s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[73af87d8-6c55-48f4-95cf-c3142a22a97e]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:44 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing instance network info cache due to event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] Acquiring lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] Acquired lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.network.neutron [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.network.neutron [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updated VIF entry in instance network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.network.neutron [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWzfbaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] <== connect_volume: return (1508ms) {'type': 'block', 'scsi_wwn': '23363303235363164', 'path': '/dev/sdf'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363303235363164', 'path': '/dev/sdf'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f8b7395a-0e98-436f-b937-182ad8d75736 req-ca4c7e31-dfb8-496e-937c-210f54e05fea service nova] Releasing lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-268762116',display_name='tempest-TestShelveInstance-server-268762116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-268762116',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-756134745',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46d0091007734312b8d33caf294d2c65',ramdisk_id='',reservation_id='r-sf7xh3dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-48517904',owner_user_name='tempest-TestShelveInstance-48517904-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:55:34Z,user_data=None,user_id='10e3f2dda9bc49f48c66beb978dbdaca',uuid=a2a860bd-802f-4760-b77b-92b7ac4ad09b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converting VIF {"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.objects.instance [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lazy-loading 'pci_devices' on Instance uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:55:45 user nova-compute[71308]:   <uuid>a2a860bd-802f-4760-b77b-92b7ac4ad09b</uuid>
Apr 14 18:55:45 user nova-compute[71308]:   <name>instance-00000015</name>
Apr 14 18:55:45 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:55:45 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:55:45 user nova-compute[71308]:   <metadata>
Apr 14 18:55:45 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:55:45 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:55:45 user nova-compute[71308]:       <nova:name>tempest-TestShelveInstance-server-268762116</nova:name>
Apr 14 18:55:45 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:55:43</nova:creationTime>
Apr 14 18:55:45 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:55:45 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:55:45 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:55:45 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:55:45 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:55:45 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:55:45 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:55:45 user nova-compute[71308]:       <nova:owner>
Apr 14 18:55:45 user nova-compute[71308]:         <nova:user uuid="10e3f2dda9bc49f48c66beb978dbdaca">tempest-TestShelveInstance-48517904-project-member</nova:user>
Apr 14 18:55:45 user nova-compute[71308]:         <nova:project uuid="46d0091007734312b8d33caf294d2c65">tempest-TestShelveInstance-48517904</nova:project>
Apr 14 18:55:45 user nova-compute[71308]:       </nova:owner>
Apr 14 18:55:45 user nova-compute[71308]:       <nova:ports>
Apr 14 18:55:45 user nova-compute[71308]:         <nova:port uuid="ce6fcefe-d72a-4cb7-8564-65fd4dcd0293">
Apr 14 18:55:45 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 18:55:45 user nova-compute[71308]:         </nova:port>
Apr 14 18:55:45 user nova-compute[71308]:       </nova:ports>
Apr 14 18:55:45 user nova-compute[71308]:     </nova:instance>
Apr 14 18:55:45 user nova-compute[71308]:   </metadata>
Apr 14 18:55:45 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:55:45 user nova-compute[71308]:     <system>
Apr 14 18:55:45 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:55:45 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:55:45 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:55:45 user nova-compute[71308]:       <entry name="serial">a2a860bd-802f-4760-b77b-92b7ac4ad09b</entry>
Apr 14 18:55:45 user nova-compute[71308]:       <entry name="uuid">a2a860bd-802f-4760-b77b-92b7ac4ad09b</entry>
Apr 14 18:55:45 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:55:45 user nova-compute[71308]:     </system>
Apr 14 18:55:45 user nova-compute[71308]:   </sysinfo>
Apr 14 18:55:45 user nova-compute[71308]:   <os>
Apr 14 18:55:45 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:55:45 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:55:45 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:55:45 user nova-compute[71308]:   </os>
Apr 14 18:55:45 user nova-compute[71308]:   <features>
Apr 14 18:55:45 user nova-compute[71308]:     <acpi/>
Apr 14 18:55:45 user nova-compute[71308]:     <apic/>
Apr 14 18:55:45 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:55:45 user nova-compute[71308]:   </features>
Apr 14 18:55:45 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:55:45 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:55:45 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:55:45 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:55:45 user nova-compute[71308]:   </clock>
Apr 14 18:55:45 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:55:45 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:55:45 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:55:45 user nova-compute[71308]:   </cpu>
Apr 14 18:55:45 user nova-compute[71308]:   <devices>
Apr 14 18:55:45 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:55:45 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:55:45 user nova-compute[71308]:       <source dev="/dev/sdf"/>
Apr 14 18:55:45 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:55:45 user nova-compute[71308]:       <serial>bbbfd96c-e671-4f85-8956-985a620429f4</serial>
Apr 14 18:55:45 user nova-compute[71308]:     </disk>
Apr 14 18:55:45 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:55:45 user nova-compute[71308]:       <mac address="fa:16:3e:e4:5d:2c"/>
Apr 14 18:55:45 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:45 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:55:45 user nova-compute[71308]:       <target dev="tapce6fcefe-d7"/>
Apr 14 18:55:45 user nova-compute[71308]:     </interface>
Apr 14 18:55:45 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:55:45 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/a2a860bd-802f-4760-b77b-92b7ac4ad09b/console.log" append="off"/>
Apr 14 18:55:45 user nova-compute[71308]:     </serial>
Apr 14 18:55:45 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:55:45 user nova-compute[71308]:     <video>
Apr 14 18:55:45 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:55:45 user nova-compute[71308]:     </video>
Apr 14 18:55:45 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:55:45 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:55:45 user nova-compute[71308]:     </rng>
Apr 14 18:55:45 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:55:45 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:55:45 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:55:45 user nova-compute[71308]:     </memballoon>
Apr 14 18:55:45 user nova-compute[71308]:   </devices>
Apr 14 18:55:45 user nova-compute[71308]: </domain>
Apr 14 18:55:45 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-268762116',display_name='tempest-TestShelveInstance-server-268762116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-268762116',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-756134745',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46d0091007734312b8d33caf294d2c65',ramdisk_id='',reservation_id='r-sf7xh3dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-48517904',owner_user_name='tempest-TestShelveInstance-48517904-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:55:34Z,user_data=None,user_id='10e3f2dda9bc49f48c66beb978dbdaca',uuid=a2a860bd-802f-4760-b77b-92b7ac4ad09b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converting VIF {"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG os_vif [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce6fcefe-d7, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce6fcefe-d7, col_values=(('external_ids', {'iface-id': 'ce6fcefe-d72a-4cb7-8564-65fd4dcd0293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:5d:2c', 'vm-uuid': 'a2a860bd-802f-4760-b77b-92b7ac4ad09b'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:45 user nova-compute[71308]: INFO os_vif [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7')
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:55:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] No VIF found with MAC fa:16:3e:e4:5d:2c, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:55:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] No waiting events found dispatching network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:47 user nova-compute[71308]: WARNING nova.compute.manager [req-84429ca3-4753-4cf5-914f-f8c3869bf1b3 req-c6e5b25b-f1c4-4827-a8e7-cf90670e96d1 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received unexpected event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 18:55:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498549.0885217, a2a860bd-802f-4760-b77b-92b7ac4ad09b => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:49 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] VM Resumed (Lifecycle Event)
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:55:49 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Instance spawned successfully.
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:49 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498549.0917134, a2a860bd-802f-4760-b77b-92b7ac4ad09b => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:49 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] VM Started (Lifecycle Event)
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-0a017352-0c90-44ae-a671-ad31ede30dc1 tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.355s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] No waiting events found dispatching network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:55:49 user nova-compute[71308]: WARNING nova.compute.manager [req-63cf5580-ab56-4ae5-a189-0050fe9d02ba req-2921e267-9171-4baf-a350-81b94587e045 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received unexpected event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance with vm_state active and task_state None.
Apr 14 18:55:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:55:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:55:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:55:52 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:55:52 user nova-compute[71308]: INFO nova.compute.claims [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Claim successful on node user
Apr 14 18:55:52 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:55:52 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:55:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:55:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:55:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:55:52 user nova-compute[71308]: DEBUG nova.network.neutron [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:55:52 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:55:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:55:52 user nova-compute[71308]: INFO nova.virt.block_device [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Booting with volume snapshot a6397e02-c899-47bd-8f26-696ca228bc26 at /dev/vda
Apr 14 18:55:52 user nova-compute[71308]: DEBUG nova.policy [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:55:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Successfully created port: 62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Successfully updated port: 62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "refresh_cache-bc9e21d7-f70e-41ea-8ab1-9014f93ad508" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquired lock "refresh_cache-bc9e21d7-f70e-41ea-8ab1-9014f93ad508" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received event network-changed-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Refreshing instance network info cache due to event network-changed-62e9aa7c-0fd9-4498-9592-9bff455b6bbf. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] Acquiring lock "refresh_cache-bc9e21d7-f70e-41ea-8ab1-9014f93ad508" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Updating instance_info_cache with network_info: [{"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Releasing lock "refresh_cache-bc9e21d7-f70e-41ea-8ab1-9014f93ad508" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Instance network_info: |[{"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] Acquired lock "refresh_cache-bc9e21d7-f70e-41ea-8ab1-9014f93ad508" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.network.neutron [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Refreshing network info cache for port 62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.network.neutron [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Updated VIF entry in instance network info cache for port 62e9aa7c-0fd9-4498-9592-9bff455b6bbf. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG nova.network.neutron [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Updating instance_info_cache with network_info: [{"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:55:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-29ee6885-6396-49c0-82c7-551debf44530 req-9dd6b14e-c964-453b-b668-6ed832191950 service nova] Releasing lock "refresh_cache-bc9e21d7-f70e-41ea-8ab1-9014f93ad508" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:55:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:56 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498541.0058727, 61944d61-738b-42a7-a95d-8caa6fa29a38 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:55:56 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] VM Stopped (Lifecycle Event)
Apr 14 18:55:56 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fedbeeb6-c5da-4666-97e2-d36dc4f3d52a None None] [instance: 61944d61-738b-42a7-a95d-8caa6fa29a38] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG os_brick.utils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[acee2a46-838c-4a7f-9b31-94decb28adc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedb495b-e017-49f9-b880-8453c3ad99d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[045b8ffa-65d3-4d04-9359-31e7f4db87eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbd278d-d909-4d16-a787-1006094bf844]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:55:58 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:55:58 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[40521432-6957-4106-bf74-4844867ab62a]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG os_brick.utils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:55:58 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Updating existing volume attachment record: f57f296c-b302-4904-a06c-d557b1363899 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:56:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:56:03 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Creating image(s)
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Ensure instance console log exists: /opt/stack/data/nova/instances/bc9e21d7-f70e-41ea-8ab1-9014f93ad508/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Start _get_guest_xml network_info=[{"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': 'f57f296c-b302-4904-a06c-d557b1363899', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMoYHhkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc9e21d7-f70e-41ea-8ab1-9014f93ad508', 'attached_at': '', 'detached_at': '', 'volume_id': '841f50c1-5bb3-4bd5-b8b5-8838cb6d8255', 'serial': '841f50c1-5bb3-4bd5-b8b5-8838cb6d8255'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:56:03 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:56:03 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMoYHhkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:56:03 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:56:03 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:56:03 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d94cce-5954-4c37-ae87-54c39ed6333b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:56:03 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b65d86-2257-41fb-a8da-8193d4fe970f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255] added
Apr 14 18:56:03 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[08617908-8671-4cef-98fc-81fcc3565d17]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec25e0bf-325c-4710-9f7f-f9362907a808]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KMoYHhkD {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KMoYHhkD" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c76bd2-1911-454f-a1b9-deeb3556e6c1]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KMoYHhkD'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[de19fe94-6cc7-4dad-9bfd-c25463173aad]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0811fe5e-e9a3-4972-96ae-308979e46b57]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0d4e43-64fa-4e00-8df1-a02537bb5261]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255, portal: 172.16.0.220,3260]
Apr 14 18:56:03 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255, portal: 172.16.0.220,3260] successful.
Apr 14 18:56:03 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.102s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8011b5cd-22cb-4980-ab11-b9e8773b8429]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63d8b83-15ed-49b3-a005-1219517753de]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:56:03 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83d42b9-d7ac-4cb5-8fe4-fef1d8b5c1a1]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:56:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMoYHhkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23933653939643865', 'path': '/dev/sdg'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933653939643865', 'path': '/dev/sdg'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1420304723',display_name='tempest-TestVolumeBootPattern-server-1420304723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1420304723',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-eftzdv33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:55:53Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=bc9e21d7-f70e-41ea-8ab1-9014f93ad508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:52:cf,bridge_name='br-int',has_traffic_filtering=True,id=62e9aa7c-0fd9-4498-9592-9bff455b6bbf,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e9aa7c-0f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.objects.instance [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'pci_devices' on Instance uuid bc9e21d7-f70e-41ea-8ab1-9014f93ad508 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:56:04 user nova-compute[71308]:   <uuid>bc9e21d7-f70e-41ea-8ab1-9014f93ad508</uuid>
Apr 14 18:56:04 user nova-compute[71308]:   <name>instance-0000001c</name>
Apr 14 18:56:04 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:56:04 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:56:04 user nova-compute[71308]:   <metadata>
Apr 14 18:56:04 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:56:04 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:56:04 user nova-compute[71308]:       <nova:name>tempest-TestVolumeBootPattern-server-1420304723</nova:name>
Apr 14 18:56:04 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:56:03</nova:creationTime>
Apr 14 18:56:04 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:56:04 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:56:04 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:56:04 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:56:04 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:56:04 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:56:04 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:56:04 user nova-compute[71308]:       <nova:owner>
Apr 14 18:56:04 user nova-compute[71308]:         <nova:user uuid="fc3bed70703a49c8bdec2f50193c7f70">tempest-TestVolumeBootPattern-1560263906-project-member</nova:user>
Apr 14 18:56:04 user nova-compute[71308]:         <nova:project uuid="72d2bf68325a4a18934a8403571c24bb">tempest-TestVolumeBootPattern-1560263906</nova:project>
Apr 14 18:56:04 user nova-compute[71308]:       </nova:owner>
Apr 14 18:56:04 user nova-compute[71308]:       <nova:ports>
Apr 14 18:56:04 user nova-compute[71308]:         <nova:port uuid="62e9aa7c-0fd9-4498-9592-9bff455b6bbf">
Apr 14 18:56:04 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 18:56:04 user nova-compute[71308]:         </nova:port>
Apr 14 18:56:04 user nova-compute[71308]:       </nova:ports>
Apr 14 18:56:04 user nova-compute[71308]:     </nova:instance>
Apr 14 18:56:04 user nova-compute[71308]:   </metadata>
Apr 14 18:56:04 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:56:04 user nova-compute[71308]:     <system>
Apr 14 18:56:04 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:56:04 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:56:04 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:56:04 user nova-compute[71308]:       <entry name="serial">bc9e21d7-f70e-41ea-8ab1-9014f93ad508</entry>
Apr 14 18:56:04 user nova-compute[71308]:       <entry name="uuid">bc9e21d7-f70e-41ea-8ab1-9014f93ad508</entry>
Apr 14 18:56:04 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:56:04 user nova-compute[71308]:     </system>
Apr 14 18:56:04 user nova-compute[71308]:   </sysinfo>
Apr 14 18:56:04 user nova-compute[71308]:   <os>
Apr 14 18:56:04 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:56:04 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:56:04 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:56:04 user nova-compute[71308]:   </os>
Apr 14 18:56:04 user nova-compute[71308]:   <features>
Apr 14 18:56:04 user nova-compute[71308]:     <acpi/>
Apr 14 18:56:04 user nova-compute[71308]:     <apic/>
Apr 14 18:56:04 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:56:04 user nova-compute[71308]:   </features>
Apr 14 18:56:04 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:56:04 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:56:04 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:56:04 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:56:04 user nova-compute[71308]:   </clock>
Apr 14 18:56:04 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:56:04 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:56:04 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:56:04 user nova-compute[71308]:   </cpu>
Apr 14 18:56:04 user nova-compute[71308]:   <devices>
Apr 14 18:56:04 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:56:04 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:56:04 user nova-compute[71308]:       <source dev="/dev/sdg"/>
Apr 14 18:56:04 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:56:04 user nova-compute[71308]:       <serial>841f50c1-5bb3-4bd5-b8b5-8838cb6d8255</serial>
Apr 14 18:56:04 user nova-compute[71308]:     </disk>
Apr 14 18:56:04 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:56:04 user nova-compute[71308]:       <mac address="fa:16:3e:2a:52:cf"/>
Apr 14 18:56:04 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:56:04 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:56:04 user nova-compute[71308]:       <target dev="tap62e9aa7c-0f"/>
Apr 14 18:56:04 user nova-compute[71308]:     </interface>
Apr 14 18:56:04 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:56:04 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/bc9e21d7-f70e-41ea-8ab1-9014f93ad508/console.log" append="off"/>
Apr 14 18:56:04 user nova-compute[71308]:     </serial>
Apr 14 18:56:04 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:56:04 user nova-compute[71308]:     <video>
Apr 14 18:56:04 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:56:04 user nova-compute[71308]:     </video>
Apr 14 18:56:04 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:56:04 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:56:04 user nova-compute[71308]:     </rng>
Apr 14 18:56:04 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:56:04 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:56:04 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:56:04 user nova-compute[71308]:     </memballoon>
Apr 14 18:56:04 user nova-compute[71308]:   </devices>
Apr 14 18:56:04 user nova-compute[71308]: </domain>
Apr 14 18:56:04 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1420304723',display_name='tempest-TestVolumeBootPattern-server-1420304723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1420304723',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-eftzdv33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:55:53Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=bc9e21d7-f70e-41ea-8ab1-9014f93ad508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:52:cf,bridge_name='br-int',has_traffic_filtering=True,id=62e9aa7c-0fd9-4498-9592-9bff455b6bbf,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e9aa7c-0f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG os_vif [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:52:cf,bridge_name='br-int',has_traffic_filtering=True,id=62e9aa7c-0fd9-4498-9592-9bff455b6bbf,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e9aa7c-0f') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62e9aa7c-0f, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62e9aa7c-0f, col_values=(('external_ids', {'iface-id': '62e9aa7c-0fd9-4498-9592-9bff455b6bbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:52:cf', 'vm-uuid': 'bc9e21d7-f70e-41ea-8ab1-9014f93ad508'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:04 user nova-compute[71308]: INFO os_vif [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:52:cf,bridge_name='br-int',has_traffic_filtering=True,id=62e9aa7c-0fd9-4498-9592-9bff455b6bbf,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e9aa7c-0f')
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:56:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No VIF found with MAC fa:16:3e:2a:52:cf, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:56:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:05 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG nova.compute.manager [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received event network-vif-plugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] Acquiring lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG nova.compute.manager [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] No waiting events found dispatching network-vif-plugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:56:06 user nova-compute[71308]: WARNING nova.compute.manager [req-5511c629-3020-459b-871d-44764b1236a8 req-067819fc-b46a-4dcf-b14e-e35647d1b619 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received unexpected event network-vif-plugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance with vm_state building and task_state spawning.
Apr 14 18:56:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:06 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498568.0230126, bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:56:08 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] VM Resumed (Lifecycle Event)
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:56:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Instance spawned successfully.
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:08 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498568.0254035, bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:56:08 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] VM Started (Lifecycle Event)
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:56:08 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:08 user nova-compute[71308]: INFO nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received event network-vif-plugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] Acquiring lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] No waiting events found dispatching network-vif-plugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:56:08 user nova-compute[71308]: WARNING nova.compute.manager [req-6f4e4acc-310f-459c-b624-e00016c3cb81 req-82f91ec9-0016-46a9-8903-0b07cc35fb94 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received unexpected event network-vif-plugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance with vm_state building and task_state spawning.
Apr 14 18:56:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:08 user nova-compute[71308]: INFO nova.compute.manager [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Took 16.32 seconds to build instance.
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-70bfd5d2-5030-40a6-8f66-4c3862412641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.454s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG nova.network.neutron [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Port 2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 binding to destination host user is already ACTIVE {{(pid=71308) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG nova.network.neutron [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG nova.network.neutron [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Creating tmpfile /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/tmpb3kcisq0 to verify with other compute node that the instance is on the same shared storage. {{(pid=71308) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:56:10 user nova-compute[71308]: WARNING nova.compute.manager [req-fcf83074-c8c7-44fb-bda1-d56637d63bdd req-80cf37e3-e78b-43ce-8f36-05c479280d1e service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state resized and task_state resize_reverting.
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:10 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance destroyed successfully.
Apr 14 18:56:10 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'resources' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:54:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:54:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_vif [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2afe22e1-00, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:10 user nova-compute[71308]: INFO os_vif [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00')
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:56:10 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e65917-7baa-42e6-a868-3a4ac5f47b9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:56:10 user nova-compute[71308]: No targets found.
Apr 14 18:56:10 user nova-compute[71308]: iSNS:
Apr 14 18:56:10 user nova-compute[71308]: No targets found.
Apr 14 18:56:10 user nova-compute[71308]: STATIC:
Apr 14 18:56:10 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:56:10 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:56:10 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:56:10 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a
Apr 14 18:56:10 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:56:10 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:56:10 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255
Apr 14 18:56:10 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:56:10 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:56:10 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7
Apr 14 18:56:10 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:56:10 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:56:10 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:56:10 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:56:10 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:56:10 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:56:10 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:56:10 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:56:10 user nova-compute[71308]: FIRMWARE:
Apr 14 18:56:10 user nova-compute[71308]: No targets found.
Apr 14 18:56:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:56:10 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:56:10 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f8fd89-d833-4635-a773-45bda63ef6e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[97badd65-e3df-4385-bc9f-fa51ac2a12db]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:56:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:10 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:56:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f226c18bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d44edae-e274-4d46-9cc2-9a22771980eb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d0d5e9-8207-45a1-8517-6b268be152e4]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[442cdf39-aca0-46e8-8076-2e23844e84ee]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:56:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[41140df6-c51e-4955-bf95-76106cd2d606]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75326f6-bc4a-48dd-b950-887ddede19ca]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4232b033-2aed-4b50-9988-78b3260f59a4]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]
Apr 14 18:56:11 user nova-compute[71308]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.
Apr 14 18:56:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:11 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:56:11 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7115MB free_disk=26.224830627441406GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f7399-e4df-452f-b887-5067b404a2be]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.839s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== disconnect_volume: return (842ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Applying migration context for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be as it has an incoming, in-progress migration d3b949eb-76a1-4e9b-86ed-14f3dd853313. Migration status is reverting {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 18:56:11 user nova-compute[71308]: INFO nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating resource usage from migration d3b949eb-76a1-4e9b-86ed-14f3dd853313
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cab14831-868c-40aa-b694-9e0185557653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Migration d3b949eb-76a1-4e9b-86ed-14f3dd853313 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:56:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=2368MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:56:12 user nova-compute[71308]: WARNING nova.compute.manager [req-5fdb7bc3-8e43-4451-81c2-8b27b0869201 req-a44a2eb4-ee17-4efc-b63a-c4f21f4f9493 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state resized and task_state resize_reverting.
Apr 14 18:56:12 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.744s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:12 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'migration_context' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:56:13 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:56:13 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:56:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.512s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:13 user nova-compute[71308]: INFO nova.compute.manager [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Swapping old allocation on dict_keys(['6bfcc2ea-9653-419f-9d55-6c72edc19d11']) held by migration d3b949eb-76a1-4e9b-86ed-14f3dd853313 for instance
Apr 14 18:56:13 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Overwriting current allocation {'allocations': {'6bfcc2ea-9653-419f-9d55-6c72edc19d11': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 33}}, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'consumer_generation': 1} on consumer aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 18:56:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:56:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:56:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-aa09363f-435d-4fa8-9f11-db0c3f4e08be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG os_brick.utils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f5a91f-be2e-44cc-9810-0d998570add5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb040185-c2eb-4717-a1eb-ba435657c544]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6087532-f1f8-44db-975e-eb075af8656d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[091efce5-2176-417e-b7b6-8e5d8a11cfa7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:56:14 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8bccfd-8640-407a-95e9-82f8e0ad9820]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG os_brick.utils [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updating instance_info_cache with network_info: [{"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:14 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:56:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Starting finish_revert_migration {{(pid=71308) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Start _get_guest_xml network_info=[{"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'd017690f-3b80-4cd7-8ad7-21d795b8c85a', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be', 'attached_at': '2023-04-14T18:56:19.000000', 'detached_at': '', 'volume_id': '1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'serial': '1aca5780-bd08-43d5-af3e-b06f7501fdbe'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:56:19 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:56:19 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'vcpu_model' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:56:19 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:56:19 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:56:19 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8916d670-bb68-4786-9578-601021fee8b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:56:19 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[582ccfbb-ee36-4a9c-8ee7-d10f1c0b2272]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe] added
Apr 14 18:56:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed99588-e73e-4a23-ad76-622b9e067d54]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[492a0a80-a7a6-4a1c-b274-c48151a64bfe]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVmnceLN {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bVmnceLN" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc4cdde-fe9b-403f-9dce-d1c22136cbf7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bVmnceLN'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[31274919-94fb-45b4-8c97-96eb03827d0f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a00089-2a1f-47c5-93de-19a6030b9816]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad18b58-329e-4fe1-b086-e2cfa0920f18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]
Apr 14 18:56:19 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.
Apr 14 18:56:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee3ec6e-d97a-49e0-8d04-0b775239b2c1]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b8831b-a060-44be-a707-8b02d2c8fd8f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:56:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:56:19 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:56:19 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[221fe828-9d3c-42b6-8c3d-e35f55db21fb]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:56:19 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23932386531386633', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932386531386633', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:54:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:56:20 user nova-compute[71308]:   <uuid>aa09363f-435d-4fa8-9f11-db0c3f4e08be</uuid>
Apr 14 18:56:20 user nova-compute[71308]:   <name>instance-00000005</name>
Apr 14 18:56:20 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:56:20 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:56:20 user nova-compute[71308]:   <metadata>
Apr 14 18:56:20 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:56:20 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:56:20 user nova-compute[71308]:       <nova:name>tempest-ServerActionsTestJSON-server-1006128169</nova:name>
Apr 14 18:56:20 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:56:19</nova:creationTime>
Apr 14 18:56:20 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:56:20 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:56:20 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:56:20 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:56:20 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:56:20 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:56:20 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:56:20 user nova-compute[71308]:       <nova:owner>
Apr 14 18:56:20 user nova-compute[71308]:         <nova:user uuid="55fa4abe2fdd48cb91f39bf8156a7793">tempest-ServerActionsTestJSON-2112054326-project-member</nova:user>
Apr 14 18:56:20 user nova-compute[71308]:         <nova:project uuid="f028a79640b848228dc6e654a0eef49b">tempest-ServerActionsTestJSON-2112054326</nova:project>
Apr 14 18:56:20 user nova-compute[71308]:       </nova:owner>
Apr 14 18:56:20 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:56:20 user nova-compute[71308]:       <nova:ports>
Apr 14 18:56:20 user nova-compute[71308]:         <nova:port uuid="2afe22e1-0044-47e2-ba5f-e1d9fd6d0620">
Apr 14 18:56:20 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 18:56:20 user nova-compute[71308]:         </nova:port>
Apr 14 18:56:20 user nova-compute[71308]:       </nova:ports>
Apr 14 18:56:20 user nova-compute[71308]:     </nova:instance>
Apr 14 18:56:20 user nova-compute[71308]:   </metadata>
Apr 14 18:56:20 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:56:20 user nova-compute[71308]:     <system>
Apr 14 18:56:20 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:56:20 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:56:20 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:56:20 user nova-compute[71308]:       <entry name="serial">aa09363f-435d-4fa8-9f11-db0c3f4e08be</entry>
Apr 14 18:56:20 user nova-compute[71308]:       <entry name="uuid">aa09363f-435d-4fa8-9f11-db0c3f4e08be</entry>
Apr 14 18:56:20 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:56:20 user nova-compute[71308]:     </system>
Apr 14 18:56:20 user nova-compute[71308]:   </sysinfo>
Apr 14 18:56:20 user nova-compute[71308]:   <os>
Apr 14 18:56:20 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:56:20 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:56:20 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:56:20 user nova-compute[71308]:   </os>
Apr 14 18:56:20 user nova-compute[71308]:   <features>
Apr 14 18:56:20 user nova-compute[71308]:     <acpi/>
Apr 14 18:56:20 user nova-compute[71308]:     <apic/>
Apr 14 18:56:20 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:56:20 user nova-compute[71308]:   </features>
Apr 14 18:56:20 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:56:20 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:56:20 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:56:20 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:56:20 user nova-compute[71308]:   </clock>
Apr 14 18:56:20 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:56:20 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:56:20 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:56:20 user nova-compute[71308]:   </cpu>
Apr 14 18:56:20 user nova-compute[71308]:   <devices>
Apr 14 18:56:20 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:56:20 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:56:20 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk"/>
Apr 14 18:56:20 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:56:20 user nova-compute[71308]:     </disk>
Apr 14 18:56:20 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:56:20 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:56:20 user nova-compute[71308]:       <source dev="/dev/sdb"/>
Apr 14 18:56:20 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:56:20 user nova-compute[71308]:       <serial>1aca5780-bd08-43d5-af3e-b06f7501fdbe</serial>
Apr 14 18:56:20 user nova-compute[71308]:     </disk>
Apr 14 18:56:20 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:56:20 user nova-compute[71308]:       <mac address="fa:16:3e:11:69:69"/>
Apr 14 18:56:20 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:56:20 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:56:20 user nova-compute[71308]:       <target dev="tap2afe22e1-00"/>
Apr 14 18:56:20 user nova-compute[71308]:     </interface>
Apr 14 18:56:20 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:56:20 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/console.log" append="off"/>
Apr 14 18:56:20 user nova-compute[71308]:     </serial>
Apr 14 18:56:20 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:56:20 user nova-compute[71308]:     <video>
Apr 14 18:56:20 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:56:20 user nova-compute[71308]:     </video>
Apr 14 18:56:20 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:56:20 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:56:20 user nova-compute[71308]:     </rng>
Apr 14 18:56:20 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:56:20 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:56:20 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:56:20 user nova-compute[71308]:     </memballoon>
Apr 14 18:56:20 user nova-compute[71308]:   </devices>
Apr 14 18:56:20 user nova-compute[71308]: </domain>
Apr 14 18:56:20 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:54:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG os_vif [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2afe22e1-00, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2afe22e1-00, col_values=(('external_ids', {'iface-id': '2afe22e1-0044-47e2-ba5f-e1d9fd6d0620', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:69:69', 'vm-uuid': 'aa09363f-435d-4fa8-9f11-db0c3f4e08be'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:56:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:20 user nova-compute[71308]: INFO os_vif [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00')
Apr 14 18:56:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:56:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:56:22 user nova-compute[71308]: WARNING nova.compute.manager [req-1f41b573-b160-4614-82c1-5f424381f321 req-84f5a433-3681-4998-905d-f2cbf830ba8b service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state resized and task_state resize_reverting.
Apr 14 18:56:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for aa09363f-435d-4fa8-9f11-db0c3f4e08be due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498584.3849947, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:56:24 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Resumed (Lifecycle Event)
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:56:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance running successfully.
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] finish_revert_migration finished successfully. {{(pid=71308) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:56:24 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498584.38575, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:56:24 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Started (Lifecycle Event)
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:56:24 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:56:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:56:24 user nova-compute[71308]: WARNING nova.compute.manager [req-c63e1583-3cda-48af-9067-c5cdd749183f req-2d613a56-0f3e-4205-b735-08cbb569f4b3 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state resized and task_state resize_reverting.
Apr 14 18:56:24 user nova-compute[71308]: INFO nova.compute.manager [None req-2e3af30f-b356-4c9f-adc9-cf1290f95ae5 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance to original state: 'active'
Apr 14 18:56:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:56:26 user nova-compute[71308]: INFO nova.compute.manager [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] instance snapshotting
Apr 14 18:56:27 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Beginning live snapshot process
Apr 14 18:56:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json -f qcow2 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json -f qcow2 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9dlzd7tg/10e26ee963aa4d28851395c5c01b51aa.delta 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9dlzd7tg/10e26ee963aa4d28851395c5c01b51aa.delta 1073741824" returned: 0 in 0.049s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:27 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 18:56:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:56:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:56:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 18:56:29 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:56:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9dlzd7tg/10e26ee963aa4d28851395c5c01b51aa.delta /opt/stack/data/nova/instances/snapshots/tmp9dlzd7tg/10e26ee963aa4d28851395c5c01b51aa {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9dlzd7tg/10e26ee963aa4d28851395c5c01b51aa.delta /opt/stack/data/nova/instances/snapshots/tmp9dlzd7tg/10e26ee963aa4d28851395c5c01b51aa" returned: 0 in 0.267s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Snapshot extracted, beginning image upload
Apr 14 18:56:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:31 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Snapshot image upload complete
Apr 14 18:56:31 user nova-compute[71308]: INFO nova.compute.manager [None req-3fd14cd3-7741-4608-b76b-056d0b676dca tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Took 4.87 seconds to snapshot the instance on the hypervisor.
Apr 14 18:56:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:56:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:56:34 user nova-compute[71308]: INFO nova.compute.claims [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Claim successful on node user
Apr 14 18:56:35 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG nova.network.neutron [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:56:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:56:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG nova.policy [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d53edaffb8f4038abd366d7942c6bc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e34cdebcd7154988a957deae140e8eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:56:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Creating image(s)
Apr 14 18:56:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "/opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "/opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "/opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.179s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.182s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk 1073741824" returned: 0 in 0.062s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.167s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Cannot resize image /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG nova.objects.instance [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'migration_context' on Instance uuid 68af5668-55ba-4150-be95-b6861afc820d {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Ensure instance console log exists: /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Successfully created port: bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:56:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Successfully updated port: bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:56:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "refresh_cache-68af5668-55ba-4150-be95-b6861afc820d" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:56:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquired lock "refresh_cache-68af5668-55ba-4150-be95-b6861afc820d" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:56:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:56:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:56:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received event network-changed-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:56:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Refreshing instance network info cache due to event network-changed-bdc608b2-229e-4fc9-a251-dbb53cafa70a. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:56:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] Acquiring lock "refresh_cache-68af5668-55ba-4150-be95-b6861afc820d" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.network.neutron [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Updating instance_info_cache with network_info: [{"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Releasing lock "refresh_cache-68af5668-55ba-4150-be95-b6861afc820d" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Instance network_info: |[{"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] Acquired lock "refresh_cache-68af5668-55ba-4150-be95-b6861afc820d" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Refreshing network info cache for port bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Start _get_guest_xml network_info=[{"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:56:38 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:56:38 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2068101705',display_name='tempest-AttachVolumeNegativeTest-server-2068101705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2068101705',id=29,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Y+X0ylyQAREcSqEFGU5KeK2JvYOxhUWKfD/HUL9LFnlnUPybIFrwN2cT6ZXOqujmMgrSHLf91Rlk8UY3HFa6RIp06SQEfEAyGI2m5HAFjxpzFiEFu0hqSEeY/EcUNmw==',key_name='tempest-keypair-1888884509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-80iby6n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=68af5668-55ba-4150-be95-b6861afc820d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2a:4d,bridge_name='br-int',has_traffic_filtering=True,id=bdc608b2-229e-4fc9-a251-dbb53cafa70a,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc608b2-22') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.objects.instance [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'pci_devices' on Instance uuid 68af5668-55ba-4150-be95-b6861afc820d {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:56:38 user nova-compute[71308]:   <uuid>68af5668-55ba-4150-be95-b6861afc820d</uuid>
Apr 14 18:56:38 user nova-compute[71308]:   <name>instance-0000001d</name>
Apr 14 18:56:38 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:56:38 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:56:38 user nova-compute[71308]:   <metadata>
Apr 14 18:56:38 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:56:38 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:56:38 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2068101705</nova:name>
Apr 14 18:56:38 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:56:38</nova:creationTime>
Apr 14 18:56:38 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:56:38 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:56:38 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:56:38 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:56:38 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:56:38 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:56:38 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:56:38 user nova-compute[71308]:       <nova:owner>
Apr 14 18:56:38 user nova-compute[71308]:         <nova:user uuid="8d53edaffb8f4038abd366d7942c6bc7">tempest-AttachVolumeNegativeTest-1648028886-project-member</nova:user>
Apr 14 18:56:38 user nova-compute[71308]:         <nova:project uuid="e34cdebcd7154988a957deae140e8eab">tempest-AttachVolumeNegativeTest-1648028886</nova:project>
Apr 14 18:56:38 user nova-compute[71308]:       </nova:owner>
Apr 14 18:56:38 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:56:38 user nova-compute[71308]:       <nova:ports>
Apr 14 18:56:38 user nova-compute[71308]:         <nova:port uuid="bdc608b2-229e-4fc9-a251-dbb53cafa70a">
Apr 14 18:56:38 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 18:56:38 user nova-compute[71308]:         </nova:port>
Apr 14 18:56:38 user nova-compute[71308]:       </nova:ports>
Apr 14 18:56:38 user nova-compute[71308]:     </nova:instance>
Apr 14 18:56:38 user nova-compute[71308]:   </metadata>
Apr 14 18:56:38 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:56:38 user nova-compute[71308]:     <system>
Apr 14 18:56:38 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:56:38 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:56:38 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:56:38 user nova-compute[71308]:       <entry name="serial">68af5668-55ba-4150-be95-b6861afc820d</entry>
Apr 14 18:56:38 user nova-compute[71308]:       <entry name="uuid">68af5668-55ba-4150-be95-b6861afc820d</entry>
Apr 14 18:56:38 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:56:38 user nova-compute[71308]:     </system>
Apr 14 18:56:38 user nova-compute[71308]:   </sysinfo>
Apr 14 18:56:38 user nova-compute[71308]:   <os>
Apr 14 18:56:38 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:56:38 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:56:38 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:56:38 user nova-compute[71308]:   </os>
Apr 14 18:56:38 user nova-compute[71308]:   <features>
Apr 14 18:56:38 user nova-compute[71308]:     <acpi/>
Apr 14 18:56:38 user nova-compute[71308]:     <apic/>
Apr 14 18:56:38 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:56:38 user nova-compute[71308]:   </features>
Apr 14 18:56:38 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:56:38 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:56:38 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:56:38 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:56:38 user nova-compute[71308]:   </clock>
Apr 14 18:56:38 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:56:38 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:56:38 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:56:38 user nova-compute[71308]:   </cpu>
Apr 14 18:56:38 user nova-compute[71308]:   <devices>
Apr 14 18:56:38 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:56:38 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:56:38 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk"/>
Apr 14 18:56:38 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:56:38 user nova-compute[71308]:     </disk>
Apr 14 18:56:38 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:56:38 user nova-compute[71308]:       <mac address="fa:16:3e:4f:2a:4d"/>
Apr 14 18:56:38 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:56:38 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:56:38 user nova-compute[71308]:       <target dev="tapbdc608b2-22"/>
Apr 14 18:56:38 user nova-compute[71308]:     </interface>
Apr 14 18:56:38 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:56:38 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/console.log" append="off"/>
Apr 14 18:56:38 user nova-compute[71308]:     </serial>
Apr 14 18:56:38 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:56:38 user nova-compute[71308]:     <video>
Apr 14 18:56:38 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:56:38 user nova-compute[71308]:     </video>
Apr 14 18:56:38 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:56:38 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:56:38 user nova-compute[71308]:     </rng>
Apr 14 18:56:38 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:56:38 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:56:38 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:56:38 user nova-compute[71308]:     </memballoon>
Apr 14 18:56:38 user nova-compute[71308]:   </devices>
Apr 14 18:56:38 user nova-compute[71308]: </domain>
Apr 14 18:56:38 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2068101705',display_name='tempest-AttachVolumeNegativeTest-server-2068101705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2068101705',id=29,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Y+X0ylyQAREcSqEFGU5KeK2JvYOxhUWKfD/HUL9LFnlnUPybIFrwN2cT6ZXOqujmMgrSHLf91Rlk8UY3HFa6RIp06SQEfEAyGI2m5HAFjxpzFiEFu0hqSEeY/EcUNmw==',key_name='tempest-keypair-1888884509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-80iby6n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=68af5668-55ba-4150-be95-b6861afc820d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2a:4d,bridge_name='br-int',has_traffic_filtering=True,id=bdc608b2-229e-4fc9-a251-dbb53cafa70a,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc608b2-22') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG os_vif [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2a:4d,bridge_name='br-int',has_traffic_filtering=True,id=bdc608b2-229e-4fc9-a251-dbb53cafa70a,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc608b2-22') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdc608b2-22, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdc608b2-22, col_values=(('external_ids', {'iface-id': 'bdc608b2-229e-4fc9-a251-dbb53cafa70a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:2a:4d', 'vm-uuid': '68af5668-55ba-4150-be95-b6861afc820d'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:38 user nova-compute[71308]: INFO os_vif [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2a:4d,bridge_name='br-int',has_traffic_filtering=True,id=bdc608b2-229e-4fc9-a251-dbb53cafa70a,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc608b2-22')
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No VIF found with MAC fa:16:3e:4f:2a:4d, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Updated VIF entry in instance network info cache for port bdc608b2-229e-4fc9-a251-dbb53cafa70a. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Updating instance_info_cache with network_info: [{"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:56:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ffac9d69-7008-49e8-bfe2-6b64b58f6573 req-3f9c458f-90fc-47ea-a10f-9643e60848b7 service nova] Releasing lock "refresh_cache-68af5668-55ba-4150-be95-b6861afc820d" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:56:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received event network-vif-plugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:56:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] No waiting events found dispatching network-vif-plugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:56:40 user nova-compute[71308]: WARNING nova.compute.manager [req-9a98f2e1-9c6c-412c-a3a7-61312885492c req-0758e6cc-341a-4307-82d6-21f39005849a service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received unexpected event network-vif-plugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance with vm_state building and task_state spawning.
Apr 14 18:56:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498602.0089767, 68af5668-55ba-4150-be95-b6861afc820d => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:56:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 68af5668-55ba-4150-be95-b6861afc820d] VM Resumed (Lifecycle Event)
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:56:42 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Instance spawned successfully.
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:56:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 68af5668-55ba-4150-be95-b6861afc820d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498602.0108397, 68af5668-55ba-4150-be95-b6861afc820d => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:56:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 68af5668-55ba-4150-be95-b6861afc820d] VM Started (Lifecycle Event)
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:56:42 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 68af5668-55ba-4150-be95-b6861afc820d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:56:42 user nova-compute[71308]: INFO nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Took 6.40 seconds to spawn the instance on the hypervisor.
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:56:42 user nova-compute[71308]: INFO nova.compute.manager [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Took 7.44 seconds to build instance.
Apr 14 18:56:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-50f7e3df-6df8-4f06-a74c-90e94aa8d86f tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.553s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received event network-vif-plugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:56:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] No waiting events found dispatching network-vif-plugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:56:42 user nova-compute[71308]: WARNING nova.compute.manager [req-9f62e17f-07f6-4bd0-afca-164ba2121162 req-74540b90-68ea-46f1-9f4d-3894f9229b02 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received unexpected event network-vif-plugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance with vm_state active and task_state None.
Apr 14 18:56:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:56:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:00 user nova-compute[71308]: INFO nova.compute.manager [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Unrescuing
Apr 14 18:57:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:57:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquired lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:57:00 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updating instance_info_cache with network_info: [{"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Releasing lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'flavor' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-unplugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-unplugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:01 user nova-compute[71308]: WARNING nova.compute.manager [req-ee4c712f-be32-46bd-93cd-1ee5ce7defaa req-65f26bfd-9d34-45ae-bdd6-76b182ca7f24 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-unplugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:57:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Instance destroyed successfully.
Apr 14 18:57:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:02 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:03 user nova-compute[71308]: WARNING nova.compute.manager [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:57:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:03 user nova-compute[71308]: WARNING nova.compute.manager [req-a5ef94d9-791c-4f6c-8cb5-25c8130794cf req-06e13bd9-cead-46f2-b7ba-f1f498d73e87 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:57:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8faea003-5d3a-4990-b102-54c285f24e97 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 1d305ab4-1813-4728-a01c-287e521a05ec due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498625.578096, 1d305ab4-1813-4728-a01c-287e521a05ec => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:57:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] VM Resumed (Lifecycle Event)
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.compute.manager [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.compute.manager [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:05 user nova-compute[71308]: WARNING nova.compute.manager [req-6960a3eb-17b8-454e-970c-e0f3b4ff5234 req-c03d8d98-b706-4334-8f1c-3984943e4a29 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state rescued and task_state unrescuing.
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:57:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498625.578566, 1d305ab4-1813-4728-a01c-287e521a05ec => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:57:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] VM Started (Lifecycle Event)
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:57:06 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:06 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:57:06 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:06 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:11 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:57:11 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7083MB free_disk=26.195816040039062GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cab14831-868c-40aa-b694-9e0185557653 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 8832a321-f1ac-411a-8fc9-1fc816bffec6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 68af5668-55ba-4150-be95-b6861afc820d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=2304MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing inventories for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating ProviderTree inventory for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating inventory in ProviderTree for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing aggregate associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, aggregates: None {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing trait associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.compute.manager [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing instance network info cache due to event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] Acquiring lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] Acquired lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:57:11 user nova-compute[71308]: DEBUG nova.network.neutron [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.853s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71308) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.compute.manager [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing instance network info cache due to event network-changed-00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] Acquiring lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.network.neutron [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updated VIF entry in instance network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.network.neutron [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updating instance_info_cache with network_info: [{"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0c11c6bc-47ab-4cce-8352-a3e6b9f61a5e req-d73a47d9-514c-4d7d-9957-8819242f0ac7 service nova] Releasing lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] Acquired lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.network.neutron [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Refreshing network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:12 user nova-compute[71308]: INFO nova.compute.manager [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Detaching volume e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7
Apr 14 18:57:12 user nova-compute[71308]: INFO nova.virt.block_device [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Attempting to driver detach volume e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 from mountpoint /dev/vdb
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Attempting to detach device vdb from instance cab14831-868c-40aa-b694-9e0185557653 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:57:12 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:57:12 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:57:12 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:57:12 user nova-compute[71308]:   <serial>e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7</serial>
Apr 14 18:57:12 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:57:12 user nova-compute[71308]: </disk>
Apr 14 18:57:12 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:57:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully detached device vdb from instance cab14831-868c-40aa-b694-9e0185557653 from the persistent domain config.
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cab14831-868c-40aa-b694-9e0185557653 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:57:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:57:12 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:57:12 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:57:12 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:57:12 user nova-compute[71308]:   <serial>e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7</serial>
Apr 14 18:57:12 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:57:12 user nova-compute[71308]: </disk>
Apr 14 18:57:12 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.network.neutron [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updated VIF entry in instance network info cache for port 00582309-5b1a-4a4d-80b2-478c8f9ada29. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.network.neutron [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Updating instance_info_cache with network_info: [{"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7a96fe3e-1325-4808-85e3-4b77ce919ed0 req-3cdad4e9-8e0b-4fba-82b8-780d3ecefa15 service nova] Releasing lock "refresh_cache-cab14831-868c-40aa-b694-9e0185557653" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498633.450885, cab14831-868c-40aa-b694-9e0185557653 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cab14831-868c-40aa-b694-9e0185557653 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:57:13 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully detached device vdb from instance cab14831-868c-40aa-b694-9e0185557653 from the live domain config.
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFyDGKNx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:57:13 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[682d3aac-2bdd-4eb0-8227-c2601131a632]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:57:13 user nova-compute[71308]: No targets found.
Apr 14 18:57:13 user nova-compute[71308]: iSNS:
Apr 14 18:57:13 user nova-compute[71308]: No targets found.
Apr 14 18:57:13 user nova-compute[71308]: STATIC:
Apr 14 18:57:13 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:57:13 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:13 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:13 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a
Apr 14 18:57:13 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:13 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:13 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255
Apr 14 18:57:13 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:13 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:13 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7
Apr 14 18:57:13 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:13 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:13 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:57:13 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:13 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:13 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:57:13 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:13 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:13 user nova-compute[71308]: FIRMWARE:
Apr 14 18:57:13 user nova-compute[71308]: No targets found.
Apr 14 18:57:13 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:57:13 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:57:13 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[96180ed1-55af-424e-a639-ddff82fb6ad8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c291f7-c12b-4e9f-b2d6-e0a81debe3bd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:13 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:13 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:13 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aaa7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45f5d46-74cd-48c5-a0ed-47ec528b91a1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f30fa-d3fa-4280-840e-178cdc8605de]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updating instance_info_cache with network_info: [{"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d681c3e5-f686-48ac-8f1a-304097ce88e3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] There are 0 instances to clean {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18b9ed4-669f-4e7e-a5dc-9db0e5d3f122]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[da72967d-c0af-456a-abba-9320318f0d90]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5eb739-ebec-4521-b78c-bafd6fd80d2d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7, portal: 172.16.0.220,3260]
Apr 14 18:57:13 user nova-compute[71308]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7, portal: 172.16.0.220,3260] successful.
Apr 14 18:57:13 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5b767ec-f24a-4105-9fe2-97ccf7d7c7f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b5de56-2d25-43dc-804e-49f0ce9bba59]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] <== disconnect_volume: return (349ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:57:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:57:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'flavor' on Instance uuid cab14831-868c-40aa-b694-9e0185557653 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-15b83389-6260-4fd7-9b95-431ace2b71a6 tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.825s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:15 user nova-compute[71308]: DEBUG nova.compute.manager [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-changed-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:15 user nova-compute[71308]: DEBUG nova.compute.manager [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Refreshing instance network info cache due to event network-changed-99fafc78-521b-4f9c-81fe-9571483238c1. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:57:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] Acquiring lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:57:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] Acquired lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:57:15 user nova-compute[71308]: DEBUG nova.network.neutron [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Refreshing network info cache for port 99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:57:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:15 user nova-compute[71308]: DEBUG nova.objects.instance [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'flavor' on Instance uuid 1feb4399-a5dc-43a7-ac78-4d22809e2737 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:16 user nova-compute[71308]: INFO nova.compute.manager [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Attaching volume f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 to /dev/vdb
Apr 14 18:57:16 user nova-compute[71308]: DEBUG os_brick.utils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG nova.network.neutron [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Updated VIF entry in instance network info cache for port 99fafc78-521b-4f9c-81fe-9571483238c1. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG nova.network.neutron [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Updating instance_info_cache with network_info: [{"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0df890-253e-4e7e-a5e1-3293f16b0d38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e7d02e2b-7fe2-4c28-b3b5-b4ae246e1914 req-0c0987e4-56ca-48b6-b402-e1439b022be9 service nova] Releasing lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c5aee-c7ac-4c5f-a4aa-f028c4912c9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad64186-31b9-4d50-8610-ecd90cec69ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2694f83-18d6-458b-84c9-ebb17f55ddb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:57:16 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0158a41d-cf25-4778-86e2-600e89c04ba4]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG os_brick.utils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Updating existing volume attachment record: 0a886b5e-510d-44c1-a85a-dba275dcf58e {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "8832a321-f1ac-411a-8fc9-1fc816bffec6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:16 user nova-compute[71308]: INFO nova.compute.manager [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Terminating instance
Apr 14 18:57:16 user nova-compute[71308]: DEBUG nova.compute.manager [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:16 user nova-compute[71308]: INFO nova.compute.manager [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Detaching volume 8870d3d7-990b-4d4c-8d7a-4591106f1a3a
Apr 14 18:57:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:17 user nova-compute[71308]: INFO nova.virt.block_device [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Attempting to driver detach volume 8870d3d7-990b-4d4c-8d7a-4591106f1a3a from mountpoint /dev/vdb
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Attempting to detach device vdb from instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:57:17 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:57:17 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:57:17 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:57:17 user nova-compute[71308]:   <serial>8870d3d7-990b-4d4c-8d7a-4591106f1a3a</serial>
Apr 14 18:57:17 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 18:57:17 user nova-compute[71308]: </disk>
Apr 14 18:57:17 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:57:17 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully detached device vdb from instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 from the persistent domain config.
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:57:17 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:57:17 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:57:17 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:57:17 user nova-compute[71308]:   <serial>8870d3d7-990b-4d4c-8d7a-4591106f1a3a</serial>
Apr 14 18:57:17 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 18:57:17 user nova-compute[71308]: </disk>
Apr 14 18:57:17 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498637.613638, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:57:17 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully detached device vdb from instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 from the live domain config.
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zpShYmcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:57:17 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Instance destroyed successfully.
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.objects.instance [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lazy-loading 'resources' on Instance uuid 8832a321-f1ac-411a-8fc9-1fc816bffec6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:55:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-346421927',display_name='tempest-ServersNegativeTestJSON-server-346421927',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-346421927',id=27,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:55:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4af68184e7654efea3187e05bb10e5e4',ramdisk_id='',reservation_id='r-jrce2kh4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1532814906',owner_user_name='tempest-ServersNegativeTestJSON-1532814906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:55:37Z,user_data=None,user_id='008a24026e844252b0be1268461bc2b1',uuid=8832a321-f1ac-411a-8fc9-1fc816bffec6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converting VIF {"id": "e4886e4d-4e50-4de8-93e6-61be10466add", "address": "fa:16:3e:03:2c:72", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4886e4d-4e", "ovs_interfaceid": "e4886e4d-4e50-4de8-93e6-61be10466add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=e4886e4d-4e50-4de8-93e6-61be10466add,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4886e4d-4e') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_vif [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=e4886e4d-4e50-4de8-93e6-61be10466add,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4886e4d-4e') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4886e4d-4e, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f948f7ea-66a2-496b-ae0e-623d9a8c57a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:57:17 user nova-compute[71308]: No targets found.
Apr 14 18:57:17 user nova-compute[71308]: iSNS:
Apr 14 18:57:17 user nova-compute[71308]: No targets found.
Apr 14 18:57:17 user nova-compute[71308]: STATIC:
Apr 14 18:57:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:57:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a
Apr 14 18:57:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255
Apr 14 18:57:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:57:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:17 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:57:17 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:17 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:17 user nova-compute[71308]: FIRMWARE:
Apr 14 18:57:17 user nova-compute[71308]: No targets found.
Apr 14 18:57:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:57:17 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:57:17 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: INFO os_vif [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=e4886e4d-4e50-4de8-93e6-61be10466add,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4886e4d-4e')
Apr 14 18:57:17 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Deleting instance files /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6_del
Apr 14 18:57:17 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Deletion of /opt/stack/data/nova/instances/8832a321-f1ac-411a-8fc9-1fc816bffec6_del complete
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab4fdb-a1d7-4eae-99fd-de4cda493943]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35da3860-d855-4b98-8ce7-3a25ef056b55]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:17 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:57:17 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:17 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:17 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:17 user nova-compute[71308]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a (non-flash)
Apr 14 18:57:17 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:17 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:17 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22307437f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a'): ({'sde'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Removing single pathed devices sde {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: INFO nova.compute.manager [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda84c59-6ffc-4af8-9b51-c2424a2df726]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a3af25-25ea-43b2-858f-8633c2be68c3]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flushing IO for device /dev/sde {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received event network-vif-unplugged-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Acquiring lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] No waiting events found dispatching network-vif-unplugged-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received event network-vif-unplugged-e4886e4d-4e50-4de8-93e6-61be10466add for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received event network-vif-plugged-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Acquiring lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] No waiting events found dispatching network-vif-plugged-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:17 user nova-compute[71308]: WARNING nova.compute.manager [req-2f4b9c65-487c-4e4f-b924-67e0be47fe7b req-9936aac6-1384-4b53-9649-f96ac1c16e44 service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received unexpected event network-vif-plugged-e4886e4d-4e50-4de8-93e6-61be10466add for instance with vm_state active and task_state deleting.
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[345dd082-4141-4128-be6a-2fa6ceb50555]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[295d63be-6848-45ba-ace0-453cd791eb8a]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e931fdbf-c9d7-44c6-8abd-6362fc1f32bb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d59a33-011b-46ab-9e0d-e60eeffa5e77]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260]
Apr 14 18:57:17 user nova-compute[71308]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a, portal: 172.16.0.220,3260] successful.
Apr 14 18:57:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8870d3d7-990b-4d4c-8d7a-4591106f1a3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[da16ebd3-0d45-45f8-a3c3-100c55d2c101]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== disconnect_volume: return (332ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:57:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:57:18 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:18 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Took 0.58 seconds to deallocate network for instance.
Apr 14 18:57:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-a2f72573-ba71-452d-a1b2-5d4b95b254c2 req-622256eb-ee0a-4b6f-8fb7-2b2a8741708d service nova] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Received event network-vif-deleted-e4886e4d-4e50-4de8-93e6-61be10466add {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:18 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:18 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:57:18 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:57:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7d046d53-6343-4e15-b52b-d1d6421e8213 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.849s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:18 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Deleted allocations for instance 8832a321-f1ac-411a-8fc9-1fc816bffec6
Apr 14 18:57:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-be4ac5fc-5251-4394-92df-c5a0755723e4 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "8832a321-f1ac-411a-8fc9-1fc816bffec6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.347s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71308) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG nova.objects.instance [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:19 user nova-compute[71308]: WARNING nova.compute.manager [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state active and task_state powering-off.
Apr 14 18:57:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:19 user nova-compute[71308]: WARNING nova.compute.manager [req-0f1e8745-112c-4a48-b355-ed3046cb9a51 req-b94448b0-9404-4102-9a15-1569005701fe service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state active and task_state powering-off.
Apr 14 18:57:20 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance destroyed successfully.
Apr 14 18:57:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-71c13240-73ab-4b25-a051-5e318d8fe7fa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.846s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfuvQrZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:57:21 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:57:21 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:57:21 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d35b050-76f0-4417-932f-60a536319146]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:57:21 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0228b92-3fcb-4f7e-aee2-04cb3201e3cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695] added
Apr 14 18:57:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[67868375-dbbe-4256-9a84-c36f6fd446e9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af58c6e-23c0-424a-b919-482d8a2fb7a9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfuvQrZJ {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfuvQrZJ" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[44032515-7657-4583-b57f-c214211fe2a4]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfuvQrZJ'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c58202-b3c5-4d85-852c-3ff6a68c6f20]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d3eec0-44b1-49f5-9b3d-75bcb71e2799]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1382502-73ca-47f8-b456-df6d94be7303]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695, portal: 172.16.0.220,3260]
Apr 14 18:57:21 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695, portal: 172.16.0.220,3260] successful.
Apr 14 18:57:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ad9b57-85e4-44d4-b8e1-1484ba03c59e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf700041-6925-4f05-844a-df2f3d5c217a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:21 user nova-compute[71308]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 (non-flash)
Apr 14 18:57:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d11c605-3e86-4669-a218-9cd780f57946]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfuvQrZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23930333364626636', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930333364626636', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG nova.objects.instance [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'flavor' on Instance uuid 1feb4399-a5dc-43a7-ac78-4d22809e2737 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:57:22 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:57:22 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:57:22 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:57:22 user nova-compute[71308]:   <serial>f70d8b48-53a5-4ce4-bc42-2e4bf34d3695</serial>
Apr 14 18:57:22 user nova-compute[71308]: </disk>
Apr 14 18:57:22 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:57:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No VIF found with MAC fa:16:3e:be:b8:29, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:57:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98be5349-e90d-418c-8640-afcd1b8242aa tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.824s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing instance network info cache due to event network-changed-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] Acquiring lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] Acquired lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Refreshing network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:24 user nova-compute[71308]: INFO nova.compute.manager [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Terminating instance
Apr 14 18:57:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.network.neutron [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updated VIF entry in instance network info cache for port ce6fcefe-d72a-4cb7-8564-65fd4dcd0293. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.network.neutron [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [{"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-495a9f4b-ac5e-42ad-99c4-6b8c488131b7 req-53aba6ba-6177-479f-aac5-541d7b8e08e0 service nova] Releasing lock "refresh_cache-a2a860bd-802f-4760-b77b-92b7ac4ad09b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:25 user nova-compute[71308]: INFO nova.compute.manager [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Detaching volume f70d8b48-53a5-4ce4-bc42-2e4bf34d3695
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-unplugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] No waiting events found dispatching network-vif-unplugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-10970784-f2d4-442d-a5e3-5b3bd8ea457c req-8565f5a4-202b-4bba-b5b2-caf365697d90 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-unplugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:57:25 user nova-compute[71308]: INFO nova.virt.block_device [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Attempting to driver detach volume f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 from mountpoint /dev/vdb
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Attempting to detach device vdb from instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:57:25 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:57:25 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:57:25 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:57:25 user nova-compute[71308]:   <serial>f70d8b48-53a5-4ce4-bc42-2e4bf34d3695</serial>
Apr 14 18:57:25 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:57:25 user nova-compute[71308]: </disk>
Apr 14 18:57:25 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:57:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Successfully detached device vdb from instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 from the persistent domain config.
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:57:25 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:57:25 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 18:57:25 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:57:25 user nova-compute[71308]:   <serial>f70d8b48-53a5-4ce4-bc42-2e4bf34d3695</serial>
Apr 14 18:57:25 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:57:25 user nova-compute[71308]: </disk>
Apr 14 18:57:25 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498645.745607, 1feb4399-a5dc-43a7-ac78-4d22809e2737 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:57:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Successfully detached device vdb from instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 from the live domain config.
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfuvQrZJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:57:25 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Instance destroyed successfully.
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.objects.instance [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lazy-loading 'resources' on Instance uuid a2a860bd-802f-4760-b77b-92b7ac4ad09b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-268762116',display_name='tempest-TestShelveInstance-server-268762116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-268762116',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx6ahRgtQXPgUyewJCWpWITHQipTZzs9c0P8Aj7ZCbMBMa2yXyDTXsh+XmK3wGceblEWwvvTYvKODXsclHUqQnjkGng7EfdTyYzxpc1qTSqvnJNTDFtuZ+jiMrT7Wx64g==',key_name='tempest-TestShelveInstance-756134745',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d0091007734312b8d33caf294d2c65',ramdisk_id='',reservation_id='r-sf7xh3dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-48517904',owner_user_name='tempest-TestShelveInstance-48517904-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:55:49Z,user_data=None,user_id='10e3f2dda9bc49f48c66beb978dbdaca',uuid=a2a860bd-802f-4760-b77b-92b7ac4ad09b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converting VIF {"id": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "address": "fa:16:3e:e4:5d:2c", "network": {"id": "05de5351-3bd0-4050-a14a-321e2749ca5d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1320884290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46d0091007734312b8d33caf294d2c65", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce6fcefe-d7", "ovs_interfaceid": "ce6fcefe-d72a-4cb7-8564-65fd4dcd0293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_vif [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce6fcefe-d7, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f771633-bf93-4764-8821-11c8d7693522]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:57:25 user nova-compute[71308]: No targets found.
Apr 14 18:57:25 user nova-compute[71308]: iSNS:
Apr 14 18:57:25 user nova-compute[71308]: No targets found.
Apr 14 18:57:25 user nova-compute[71308]: STATIC:
Apr 14 18:57:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:57:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255
Apr 14 18:57:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695
Apr 14 18:57:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:57:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:57:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:25 user nova-compute[71308]: FIRMWARE:
Apr 14 18:57:25 user nova-compute[71308]: No targets found.
Apr 14 18:57:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:57:25 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:57:25 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:25 user nova-compute[71308]: INFO os_vif [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:5d:2c,bridge_name='br-int',has_traffic_filtering=True,id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293,network=Network(05de5351-3bd0-4050-a14a-321e2749ca5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce6fcefe-d7')
Apr 14 18:57:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkWzfbaw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:57:25 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[120bdb49-b7a9-446a-8ef6-82ca8a5f9103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7648034-a4df-4a6e-a71c-9f083c9a51ee]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:25 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:25 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:25 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:25 user nova-compute[71308]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 (non-flash)
Apr 14 18:57:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:25 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:25 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:25 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:25 user nova-compute[71308]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 (non-flash)
Apr 14 18:57:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aaa5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4a650b-c467-4c77-b9b4-a0bb25bd2d02]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae4d70-c872-4521-9be7-738a88b53759]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0474e7d0-e1cd-4a1e-ac9c-00aa7e7e1e70]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c381259-d561-4be0-98de-7720641778d0]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5baac97-cd5b-4e09-9e6d-420e34493d23]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78de5d0-a849-4374-8ec4-867ebbc75ec7]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695, portal: 172.16.0.220,3260]
Apr 14 18:57:26 user nova-compute[71308]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695, portal: 172.16.0.220,3260] successful.
Apr 14 18:57:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f70d8b48-53a5-4ce4-bc42-2e4bf34d3695 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[406b916d-cec6-4fb3-baab-a102dd8b4b1e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] <== disconnect_volume: return (341ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.293s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e799a4a8-5c4a-4b16-ba0d-c3b8e802e7a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:57:26 user nova-compute[71308]: No targets found.
Apr 14 18:57:26 user nova-compute[71308]: iSNS:
Apr 14 18:57:26 user nova-compute[71308]: No targets found.
Apr 14 18:57:26 user nova-compute[71308]: STATIC:
Apr 14 18:57:26 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:57:26 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:26 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:26 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255
Apr 14 18:57:26 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:26 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:26 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4
Apr 14 18:57:26 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:26 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:26 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:57:26 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:26 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:26 user nova-compute[71308]: FIRMWARE:
Apr 14 18:57:26 user nova-compute[71308]: No targets found.
Apr 14 18:57:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:57:26 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:57:26 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba0d0b0-3f7b-4181-8969-40b3491a1037]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4249db-ebda-4e7c-8bf6-8cff4403c7d4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:26 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:26 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:26 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:26 user nova-compute[71308]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 (non-flash)
Apr 14 18:57:26 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:26 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22306864d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4'): ({'sdf'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Removing single pathed devices sdf {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3fc382-abbe-4d68-b5a1-4e7ea462270e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2327081d-3521-485b-b46f-ab5cedf3f8f9]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Flushing IO for device /dev/sdf {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f6a797-a602-4d94-85b2-b1075c1deb59]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c747eb4e-2b3e-464f-a470-9a38666f60dc]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff7a337-bff0-4b8d-bccb-29da92c09a4d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[470196a5-fa96-4e0e-85f7-2495de31588b]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260]
Apr 14 18:57:26 user nova-compute[71308]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4, portal: 172.16.0.220,3260] successful.
Apr 14 18:57:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbfd96c-e671-4f85-8956-985a620429f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb32e07-7805-47c9-9b6f-1723865f8c6a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] <== disconnect_volume: return (599ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:57:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Deleting instance files /opt/stack/data/nova/instances/a2a860bd-802f-4760-b77b-92b7ac4ad09b_del
Apr 14 18:57:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Deletion of /opt/stack/data/nova/instances/a2a860bd-802f-4760-b77b-92b7ac4ad09b_del complete
Apr 14 18:57:26 user nova-compute[71308]: INFO nova.compute.manager [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Took 1.74 seconds to destroy the instance on the hypervisor.
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG nova.objects.instance [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'flavor' on Instance uuid 1feb4399-a5dc-43a7-ac78-4d22809e2737 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-12d3b2fa-ded1-49c3-b468-fa163f0e7d7c tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.845s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:27 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:27 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Took 0.60 seconds to deallocate network for instance.
Apr 14 18:57:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-deleted-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:27 user nova-compute[71308]: INFO nova.compute.manager [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Neutron deleted interface ce6fcefe-d72a-4cb7-8564-65fd4dcd0293; detaching it from the instance and deleting it from the info cache
Apr 14 18:57:27 user nova-compute[71308]: DEBUG nova.network.neutron [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-ca67474d-48e2-4234-b48d-fa8e44d686de req-2dd1104e-7642-4295-a818-97c211bcf533 service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Detach interface failed, port_id=ce6fcefe-d72a-4cb7-8564-65fd4dcd0293, reason: Instance a2a860bd-802f-4760-b77b-92b7ac4ad09b could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 18:57:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] Acquiring lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] No waiting events found dispatching network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:27 user nova-compute[71308]: WARNING nova.compute.manager [req-f25ea7e7-5c43-4a94-9722-0e3eb084c598 req-2d147072-d3b6-4cec-bb6f-8670bba60e3c service nova] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Received unexpected event network-vif-plugged-ce6fcefe-d72a-4cb7-8564-65fd4dcd0293 for instance with vm_state active and task_state deleting.
Apr 14 18:57:27 user nova-compute[71308]: INFO nova.compute.manager [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Took 0.78 seconds to detach 1 volumes for instance.
Apr 14 18:57:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Deleting volume: bbbfd96c-e671-4f85-8956-985a620429f4 {{(pid=71308) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 18:57:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:28 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:57:28 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:57:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:28 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Deleted allocations for instance a2a860bd-802f-4760-b77b-92b7ac4ad09b
Apr 14 18:57:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-08f99470-8e64-4cd5-8e1d-c0316bfad24f tempest-TestShelveInstance-48517904 tempest-TestShelveInstance-48517904-project-member] Lock "a2a860bd-802f-4760-b77b-92b7ac4ad09b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.844s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:32 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498637.626521, 8832a321-f1ac-411a-8fc9-1fc816bffec6 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:57:32 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] VM Stopped (Lifecycle Event)
Apr 14 18:57:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-2c96d564-2145-4efe-9d71-62d2b2028deb None None] [instance: 8832a321-f1ac-411a-8fc9-1fc816bffec6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:57:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:34 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:57:34 user nova-compute[71308]: INFO nova.compute.claims [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Claim successful on node user
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498640.00986, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:57:35 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] VM Stopped (Lifecycle Event)
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-394fa8e9-0253-4843-b681-4277dd9c5ab9 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-394fa8e9-0253-4843-b681-4277dd9c5ab9 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:57:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:57:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:57:35 user nova-compute[71308]: INFO nova.virt.block_device [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Booting with volume-backed-image 09ac11b8-b53a-4bc5-8785-aad1f28737d3 at /dev/vda
Apr 14 18:57:35 user nova-compute[71308]: DEBUG nova.policy [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a644b8bb9b90494ba670da8315bfe005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '424e732759884efa8fd126cd9a082c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:57:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Successfully created port: 3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Successfully updated port: 3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquired lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-changed-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Refreshing instance network info cache due to event network-changed-3a14f42c-2105-477c-8012-069d489f2d91. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] Acquiring lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Updating instance_info_cache with network_info: [{"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Releasing lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Instance network_info: |[{"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] Acquired lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:57:37 user nova-compute[71308]: DEBUG nova.network.neutron [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Refreshing network info cache for port 3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:57:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Updated VIF entry in instance network info cache for port 3a14f42c-2105-477c-8012-069d489f2d91. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:57:38 user nova-compute[71308]: DEBUG nova.network.neutron [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Updating instance_info_cache with network_info: [{"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-765ac660-d2de-4723-87e6-c653bfb1eefd req-35447d44-1667-41fd-b230-a3d52301227e service nova] Releasing lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:57:40 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498645.755405, a2a860bd-802f-4760-b77b-92b7ac4ad09b => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:57:40 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] VM Stopped (Lifecycle Event)
Apr 14 18:57:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-cd61a2a8-326a-440b-b146-9614fe75ad85 None None] [instance: a2a860bd-802f-4760-b77b-92b7ac4ad09b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG os_brick.utils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24a4ac-1159-4db6-a649-235ebd4cd171]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b411a349-a296-4362-a8d8-7c8972acb084]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf23008-f5de-486f-9556-027b74e789ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e47c439-cd5c-40a0-91d1-104a76abc7a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:57:41 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:57:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad225ad-bde9-4105-af77-7cb1a3bb14e7]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG os_brick.utils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:57:41 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Updating existing volume attachment record: 6a462f5e-74d6-41b5-84ff-c6bbf430a866 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:42 user nova-compute[71308]: INFO nova.compute.manager [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Terminating instance
Apr 14 18:57:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received event network-vif-unplugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] Acquiring lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] No waiting events found dispatching network-vif-unplugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-817b0303-72bc-4f73-8c1a-3dbecea24a8b req-01d5c455-53cb-4534-9b31-d4e0e97a3188 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received event network-vif-unplugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:57:43 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Instance destroyed successfully.
Apr 14 18:57:43 user nova-compute[71308]: DEBUG nova.objects.instance [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'resources' on Instance uuid bc9e21d7-f70e-41ea-8ab1-9014f93ad508 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1420304723',display_name='tempest-TestVolumeBootPattern-server-1420304723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1420304723',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:56:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-eftzdv33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:56:08Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=bc9e21d7-f70e-41ea-8ab1-9014f93ad508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "address": "fa:16:3e:2a:52:cf", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62e9aa7c-0f", "ovs_interfaceid": "62e9aa7c-0fd9-4498-9592-9bff455b6bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:52:cf,bridge_name='br-int',has_traffic_filtering=True,id=62e9aa7c-0fd9-4498-9592-9bff455b6bbf,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e9aa7c-0f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_vif [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:52:cf,bridge_name='br-int',has_traffic_filtering=True,id=62e9aa7c-0fd9-4498-9592-9bff455b6bbf,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e9aa7c-0f') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62e9aa7c-0f, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:43 user nova-compute[71308]: INFO os_vif [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:52:cf,bridge_name='br-int',has_traffic_filtering=True,id=62e9aa7c-0fd9-4498-9592-9bff455b6bbf,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62e9aa7c-0f')
Apr 14 18:57:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMoYHhkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:57:43 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ddbef2-29f9-4378-83d9-7e2e1be91c0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:57:43 user nova-compute[71308]: No targets found.
Apr 14 18:57:43 user nova-compute[71308]: iSNS:
Apr 14 18:57:43 user nova-compute[71308]: No targets found.
Apr 14 18:57:43 user nova-compute[71308]: STATIC:
Apr 14 18:57:43 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:57:43 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:43 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:43 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255
Apr 14 18:57:43 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:43 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:43 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:57:43 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:57:43 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:57:43 user nova-compute[71308]: FIRMWARE:
Apr 14 18:57:43 user nova-compute[71308]: No targets found.
Apr 14 18:57:43 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:57:43 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:57:43 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ea4e43-9a47-4e49-879c-1f3fb044f478]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad082dfc-607e-42bb-bf28-65b7f7d96bec]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:43 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:43 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:43 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:43 user nova-compute[71308]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 (non-flash)
Apr 14 18:57:43 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:43 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2230741990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255'): ({'sdg'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Removing single pathed devices sdg {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[37426e5a-8e70-4915-bd64-71d8b1afaa5f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f80b2e-bc6b-47e1-9b9b-866f58af77a1]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flushing IO for device /dev/sdg {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[567880a7-b36b-4543-814c-0f2404034af2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[78772be2-4471-4244-9d85-5f4f0c959ac0]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adde230-92e3-447d-b58e-2456acd07da7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dafd01-2005-4dc8-946b-422524cca2b8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255, portal: 172.16.0.220,3260]
Apr 14 18:57:43 user nova-compute[71308]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255, portal: 172.16.0.220,3260] successful.
Apr 14 18:57:43 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3751a8-b973-4e44-8166-4f2b023631e7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== disconnect_volume: return (328ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:57:43 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Deleting instance files /opt/stack/data/nova/instances/bc9e21d7-f70e-41ea-8ab1-9014f93ad508_del
Apr 14 18:57:43 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Deletion of /opt/stack/data/nova/instances/bc9e21d7-f70e-41ea-8ab1-9014f93ad508_del complete
Apr 14 18:57:43 user nova-compute[71308]: INFO nova.compute.manager [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 14 18:57:43 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:57:43 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:57:44 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:57:44 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Took 0.54 seconds to deallocate network for instance.
Apr 14 18:57:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received event network-vif-plugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] Acquiring lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] No waiting events found dispatching network-vif-plugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:44 user nova-compute[71308]: WARNING nova.compute.manager [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received unexpected event network-vif-plugged-62e9aa7c-0fd9-4498-9592-9bff455b6bbf for instance with vm_state active and task_state deleting.
Apr 14 18:57:44 user nova-compute[71308]: DEBUG nova.compute.manager [req-5f1d4cf1-f7c3-4126-b3bd-174b3574e0d4 req-dc5d09cb-c439-45fb-b3dc-b6518d1f2103 service nova] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Received event network-vif-deleted-62e9aa7c-0fd9-4498-9592-9bff455b6bbf {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:45 user nova-compute[71308]: INFO nova.compute.manager [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Took 0.81 seconds to detach 1 volumes for instance.
Apr 14 18:57:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Deleting volume: 841f50c1-5bb3-4bd5-b8b5-8838cb6d8255 {{(pid=71308) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 18:57:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:45 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:57:45 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:57:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:45 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Deleted allocations for instance bc9e21d7-f70e-41ea-8ab1-9014f93ad508
Apr 14 18:57:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3e-89cd-44fe-b0fc-81ad6c89d076 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "bc9e21d7-f70e-41ea-8ab1-9014f93ad508" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.232s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:57:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Creating image(s)
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Ensure instance console log exists: /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Start _get_guest_xml network_info=[{"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '6a462f5e-74d6-41b5-84ff-c6bbf430a866', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyaEeBsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1', 'attached_at': '', 'detached_at': '', 'volume_id': '30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 'serial': '30e0fe34-9aba-4c9b-9fa6-18333cbc07b9'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:57:46 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:57:46 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyaEeBsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:57:46 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:57:46 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:57:46 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[548e9d3c-c389-4832-9e18-ecc0332d2e5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:57:46 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7855e5c-0b5b-4051-8dd7-f1b94bfccb06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9] added
Apr 14 18:57:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8709e9-01c5-4220-98f2-f541315f9e5a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8449173-d5d4-494c-93d5-76118ccfe4e3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JyaEeBsX {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JyaEeBsX" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[696ed591-d9ed-4563-a920-5b228e4509a9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JyaEeBsX'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8dfc15-f2f9-4d04-ae7c-34d1fc7f6e1b]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22b31fe-e059-4223-b81a-714dffeae6d1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:46 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:46 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[58690087-e90b-4c78-a9ee-6cd883c54c32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9, portal: 172.16.0.220,3260]
Apr 14 18:57:46 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9, portal: 172.16.0.220,3260] successful.
Apr 14 18:57:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[31534969-ec12-4c60-a207-40a0de4836b4]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d69ca0-d694-4032-bd84-ead406b87d09]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:46 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:46 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:57:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:57:46 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:57:46 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:57:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22bda26-0e89-452a-8eac-ff8bedd8d625]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:57:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyaEeBsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23137393336363334', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137393336363334', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1753583208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1753583208',id=30,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-7fe4io26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:57:35Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:c2,bridge_name='br-int',has_traffic_filtering=True,id=3a14f42c-2105-477c-8012-069d489f2d91,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a14f42c-21') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:57:47 user nova-compute[71308]:   <uuid>1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1</uuid>
Apr 14 18:57:47 user nova-compute[71308]:   <name>instance-0000001e</name>
Apr 14 18:57:47 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:57:47 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:57:47 user nova-compute[71308]:   <metadata>
Apr 14 18:57:47 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:57:47 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:57:47 user nova-compute[71308]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1753583208</nova:name>
Apr 14 18:57:47 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:57:46</nova:creationTime>
Apr 14 18:57:47 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:57:47 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:57:47 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:57:47 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:57:47 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:57:47 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:57:47 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:57:47 user nova-compute[71308]:       <nova:owner>
Apr 14 18:57:47 user nova-compute[71308]:         <nova:user uuid="a644b8bb9b90494ba670da8315bfe005">tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member</nova:user>
Apr 14 18:57:47 user nova-compute[71308]:         <nova:project uuid="424e732759884efa8fd126cd9a082c8a">tempest-ServerBootFromVolumeStableRescueTest-1815450365</nova:project>
Apr 14 18:57:47 user nova-compute[71308]:       </nova:owner>
Apr 14 18:57:47 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:57:47 user nova-compute[71308]:       <nova:ports>
Apr 14 18:57:47 user nova-compute[71308]:         <nova:port uuid="3a14f42c-2105-477c-8012-069d489f2d91">
Apr 14 18:57:47 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 18:57:47 user nova-compute[71308]:         </nova:port>
Apr 14 18:57:47 user nova-compute[71308]:       </nova:ports>
Apr 14 18:57:47 user nova-compute[71308]:     </nova:instance>
Apr 14 18:57:47 user nova-compute[71308]:   </metadata>
Apr 14 18:57:47 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:57:47 user nova-compute[71308]:     <system>
Apr 14 18:57:47 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:57:47 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:57:47 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:57:47 user nova-compute[71308]:       <entry name="serial">1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1</entry>
Apr 14 18:57:47 user nova-compute[71308]:       <entry name="uuid">1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1</entry>
Apr 14 18:57:47 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:57:47 user nova-compute[71308]:     </system>
Apr 14 18:57:47 user nova-compute[71308]:   </sysinfo>
Apr 14 18:57:47 user nova-compute[71308]:   <os>
Apr 14 18:57:47 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:57:47 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:57:47 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:57:47 user nova-compute[71308]:   </os>
Apr 14 18:57:47 user nova-compute[71308]:   <features>
Apr 14 18:57:47 user nova-compute[71308]:     <acpi/>
Apr 14 18:57:47 user nova-compute[71308]:     <apic/>
Apr 14 18:57:47 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:57:47 user nova-compute[71308]:   </features>
Apr 14 18:57:47 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:57:47 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:57:47 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:57:47 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:57:47 user nova-compute[71308]:   </clock>
Apr 14 18:57:47 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:57:47 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:57:47 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:57:47 user nova-compute[71308]:   </cpu>
Apr 14 18:57:47 user nova-compute[71308]:   <devices>
Apr 14 18:57:47 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:57:47 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:57:47 user nova-compute[71308]:       <source dev="/dev/sdc"/>
Apr 14 18:57:47 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:57:47 user nova-compute[71308]:       <serial>30e0fe34-9aba-4c9b-9fa6-18333cbc07b9</serial>
Apr 14 18:57:47 user nova-compute[71308]:     </disk>
Apr 14 18:57:47 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:57:47 user nova-compute[71308]:       <mac address="fa:16:3e:bc:fb:c2"/>
Apr 14 18:57:47 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:57:47 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:57:47 user nova-compute[71308]:       <target dev="tap3a14f42c-21"/>
Apr 14 18:57:47 user nova-compute[71308]:     </interface>
Apr 14 18:57:47 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:57:47 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/console.log" append="off"/>
Apr 14 18:57:47 user nova-compute[71308]:     </serial>
Apr 14 18:57:47 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:57:47 user nova-compute[71308]:     <video>
Apr 14 18:57:47 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:57:47 user nova-compute[71308]:     </video>
Apr 14 18:57:47 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:57:47 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:57:47 user nova-compute[71308]:     </rng>
Apr 14 18:57:47 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:57:47 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:57:47 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:57:47 user nova-compute[71308]:     </memballoon>
Apr 14 18:57:47 user nova-compute[71308]:   </devices>
Apr 14 18:57:47 user nova-compute[71308]: </domain>
Apr 14 18:57:47 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1753583208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1753583208',id=30,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-7fe4io26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:57:35Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:c2,bridge_name='br-int',has_traffic_filtering=True,id=3a14f42c-2105-477c-8012-069d489f2d91,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a14f42c-21') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG os_vif [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:c2,bridge_name='br-int',has_traffic_filtering=True,id=3a14f42c-2105-477c-8012-069d489f2d91,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a14f42c-21') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a14f42c-21, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a14f42c-21, col_values=(('external_ids', {'iface-id': '3a14f42c-2105-477c-8012-069d489f2d91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:fb:c2', 'vm-uuid': '1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:47 user nova-compute[71308]: INFO os_vif [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:fb:c2,bridge_name='br-int',has_traffic_filtering=True,id=3a14f42c-2105-477c-8012-069d489f2d91,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a14f42c-21')
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:57:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No VIF found with MAC fa:16:3e:bc:fb:c2, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:57:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:49 user nova-compute[71308]: WARNING nova.compute.manager [req-0d760d63-9331-4102-9a42-8e35336fc12d req-cb39e2b3-adf7-45c4-989e-7a6ee0623e2d service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state building and task_state spawning.
Apr 14 18:57:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498671.2455578, 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:57:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] VM Resumed (Lifecycle Event)
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:57:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Instance spawned successfully.
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:57:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498671.2467494, 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:57:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] VM Started (Lifecycle Event)
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:57:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:57:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Took 5.00 seconds to spawn the instance on the hypervisor.
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:51 user nova-compute[71308]: INFO nova.compute.manager [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Took 16.81 seconds to build instance.
Apr 14 18:57:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d500afaa-6e2e-4801-97ff-dfb420e94916 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.912s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:57:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:57:51 user nova-compute[71308]: WARNING nova.compute.manager [req-8584d719-e324-42a3-96ed-980c1e275805 req-7ae0f63a-64e8-4b2e-ad78-ad6359a6d56f service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state active and task_state None.
Apr 14 18:57:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:57:58 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498663.2586265, bc9e21d7-f70e-41ea-8ab1-9014f93ad508 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:57:58 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] VM Stopped (Lifecycle Event)
Apr 14 18:57:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a4dcfcaa-20a3-41a2-bc5d-119b26c3ab71 None None] [instance: bc9e21d7-f70e-41ea-8ab1-9014f93ad508] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:57:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:03 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:05 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:06 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:06 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:58:06 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:07 user nova-compute[71308]: INFO nova.compute.manager [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Terminating instance
Apr 14 18:58:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-unplugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] No waiting events found dispatching network-vif-unplugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-6937fc0c-d034-48e1-9a0f-08843ee0ac21 req-1a668b39-66a7-47e4-8e45-3ea086becbe0 service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-unplugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: cab14831-868c-40aa-b694-9e0185557653] Instance destroyed successfully.
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.objects.instance [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lazy-loading 'resources' on Instance uuid cab14831-868c-40aa-b694-9e0185557653 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1520840237',display_name='tempest-TestMinimumBasicScenario-server-1520840237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1520840237',id=23,image_ref='820f1452-474e-4205-aea7-0d8c120229da',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOqKy4QJH9Ahk78Dio5o1pKmdxgls1Vij0F1hpELGXEH2iLM2PcaG5f/FMMxqCoIhYjKPIFlM0PNsjOP/N9XDX+woRo9QWFmiSBk1ThRc0RqtjvABAaJ1upzg7Tk3FDAQ==',key_name='tempest-TestMinimumBasicScenario-1594101407',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8e6b4e98cf9e4f96b79c3288dfe0da89',ramdisk_id='',reservation_id='r-wg3g97ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='820f1452-474e-4205-aea7-0d8c120229da',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1257841115',owner_user_name='tempest-TestMinimumBasicScenario-1257841115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:55:28Z,user_data=None,user_id='67e1d31c2d9048699758779dedf7d3ac',uuid=cab14831-868c-40aa-b694-9e0185557653,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converting VIF {"id": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "address": "fa:16:3e:31:ab:a9", "network": {"id": "abf4a6b2-999d-423c-8c7b-f0f773160410", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1149083350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8e6b4e98cf9e4f96b79c3288dfe0da89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00582309-5b", "ovs_interfaceid": "00582309-5b1a-4a4d-80b2-478c8f9ada29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:ab:a9,bridge_name='br-int',has_traffic_filtering=True,id=00582309-5b1a-4a4d-80b2-478c8f9ada29,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00582309-5b') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG os_vif [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:ab:a9,bridge_name='br-int',has_traffic_filtering=True,id=00582309-5b1a-4a4d-80b2-478c8f9ada29,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00582309-5b') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00582309-5b, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:08 user nova-compute[71308]: INFO os_vif [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:ab:a9,bridge_name='br-int',has_traffic_filtering=True,id=00582309-5b1a-4a4d-80b2-478c8f9ada29,network=Network(abf4a6b2-999d-423c-8c7b-f0f773160410),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00582309-5b')
Apr 14 18:58:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Deleting instance files /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653_del
Apr 14 18:58:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Deletion of /opt/stack/data/nova/instances/cab14831-868c-40aa-b694-9e0185557653_del complete
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:08 user nova-compute[71308]: INFO nova.compute.manager [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] [instance: cab14831-868c-40aa-b694-9e0185557653] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: cab14831-868c-40aa-b694-9e0185557653] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: cab14831-868c-40aa-b694-9e0185557653] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: cab14831-868c-40aa-b694-9e0185557653] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:58:09 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: cab14831-868c-40aa-b694-9e0185557653] Took 0.58 seconds to deallocate network for instance.
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:09 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Deleted allocations for instance cab14831-868c-40aa-b694-9e0185557653
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-98788afc-4a87-4acf-90f6-2f99002c890c tempest-TestMinimumBasicScenario-1257841115 tempest-TestMinimumBasicScenario-1257841115-project-member] Lock "cab14831-868c-40aa-b694-9e0185557653" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.267s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] Acquiring lock "cab14831-868c-40aa-b694-9e0185557653-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] Lock "cab14831-868c-40aa-b694-9e0185557653-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] No waiting events found dispatching network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:58:10 user nova-compute[71308]: WARNING nova.compute.manager [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received unexpected event network-vif-plugged-00582309-5b1a-4a4d-80b2-478c8f9ada29 for instance with vm_state deleted and task_state None.
Apr 14 18:58:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-6fdb0486-015d-4a40-b434-cafb8067c5ea req-e61e497e-3f29-46a7-bbfd-8d7ec9919bbc service nova] [instance: cab14831-868c-40aa-b694-9e0185557653] Received event network-vif-deleted-00582309-5b1a-4a4d-80b2-478c8f9ada29 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:10 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:58:10 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:58:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7361MB free_disk=26.211700439453125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance aa09363f-435d-4fa8-9f11-db0c3f4e08be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 68af5668-55ba-4150-be95-b6861afc820d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:58:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Updating instance_info_cache with network_info: [{"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:15 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:58:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:58:19 user nova-compute[71308]: INFO nova.compute.manager [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] instance snapshotting
Apr 14 18:58:19 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Beginning live snapshot process
Apr 14 18:58:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json -f qcow2 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json -f qcow2 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd9rp409i/b54e10effcc641ed914dafdeec8fa3a5.delta 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd9rp409i/b54e10effcc641ed914dafdeec8fa3a5.delta 1073741824" returned: 0 in 0.057s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:20 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 18:58:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:58:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71308) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 18:58:21 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 18:58:21 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:58:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd9rp409i/b54e10effcc641ed914dafdeec8fa3a5.delta /opt/stack/data/nova/instances/snapshots/tmpd9rp409i/b54e10effcc641ed914dafdeec8fa3a5 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd9rp409i/b54e10effcc641ed914dafdeec8fa3a5.delta /opt/stack/data/nova/instances/snapshots/tmpd9rp409i/b54e10effcc641ed914dafdeec8fa3a5" returned: 0 in 0.366s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:21 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Snapshot extracted, beginning image upload
Apr 14 18:58:23 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498688.44419, cab14831-868c-40aa-b694-9e0185557653 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:58:23 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: cab14831-868c-40aa-b694-9e0185557653] VM Stopped (Lifecycle Event)
Apr 14 18:58:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f06a5249-47cb-4781-a724-6032cb08cf58 None None] [instance: cab14831-868c-40aa-b694-9e0185557653] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:58:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Snapshot image upload complete
Apr 14 18:58:24 user nova-compute[71308]: INFO nova.compute.manager [None req-60cf3da0-96cf-4c6d-b33f-d939091a6177 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Took 5.26 seconds to snapshot the instance on the hypervisor.
Apr 14 18:58:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received event network-changed-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:58:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Refreshing instance network info cache due to event network-changed-bdc608b2-229e-4fc9-a251-dbb53cafa70a. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:58:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] Acquiring lock "refresh_cache-68af5668-55ba-4150-be95-b6861afc820d" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:58:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] Acquired lock "refresh_cache-68af5668-55ba-4150-be95-b6861afc820d" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:58:25 user nova-compute[71308]: DEBUG nova.network.neutron [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Refreshing network info cache for port bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:58:26 user nova-compute[71308]: DEBUG nova.network.neutron [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Updated VIF entry in instance network info cache for port bdc608b2-229e-4fc9-a251-dbb53cafa70a. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:58:26 user nova-compute[71308]: DEBUG nova.network.neutron [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Updating instance_info_cache with network_info: [{"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:58:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f1710d42-560e-41ae-bbdf-497e34230803 req-fbab37cf-8f77-40f8-b30f-40684823a6ef service nova] Releasing lock "refresh_cache-68af5668-55ba-4150-be95-b6861afc820d" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'flavor' on Instance uuid 68af5668-55ba-4150-be95-b6861afc820d {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:28 user nova-compute[71308]: INFO nova.compute.manager [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Attaching volume c74300f0-2575-455e-93c8-8de79d10c378 to /dev/vdb
Apr 14 18:58:28 user nova-compute[71308]: DEBUG os_brick.utils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6588971-285f-42df-a96f-0b0d46687e40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:28 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c56f05-993b-4c2e-9487-6b2d6bff8dde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ea69f2-7ad3-433a-96c3-00f315659175]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[342112fb-8807-40d7-87ae-6c8f9d089bc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:58:29 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:58:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4de500-e87f-4da9-ac5a-bc97facd551a]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG os_brick.utils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:58:29 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Updating existing volume attachment record: 97595214-a2ad-467f-94e1-06e600e91ad9 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:58:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:58:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:58:32 user nova-compute[71308]: INFO nova.compute.claims [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Claim successful on node user
Apr 14 18:58:32 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:58:32 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG nova.network.neutron [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:58:33 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:58:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG nova.policy [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a9414d0c24643fdb162aad828c736bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '921435d84194431c886ec1ed1848d4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:58:33 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Creating image(s)
Apr 14 18:58:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "/opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "/opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "/opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "67624d128dc646f391e6eb4fc9ae0a565db19e8e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "67624d128dc646f391e6eb4fc9ae0a565db19e8e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzJxelVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:58:34 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:58:34 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:58:34 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86e5274-8679-49ab-b3ca-c98508e6894a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:58:34 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5a8548-7976-4f5d-a136-6a867ebea910]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378] added
Apr 14 18:58:34 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e.part --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG nova.virt.images [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] b06b95d0-3f1e-4cfc-b707-9f58271dcb39 was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e.part /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d2e2bb-8366-4c5a-ba80-c4e5ebd2039d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f3fdb-7364-49bc-b231-29e42ff022ba]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzJxelVf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzJxelVf" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef2597f-234c-451d-840b-fe20bf95da23]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dzJxelVf'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a467c21-8a19-4424-8654-578063d19e7c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.098s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e9c46a-cf16-4507-b373-353a0d4a9c7c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --login" returned: 0 in 0.139s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3aed9-02ec-4b29-b0ae-a61d17849008]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378, portal: 172.16.0.220,3260]
Apr 14 18:58:34 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378, portal: 172.16.0.220,3260] successful.
Apr 14 18:58:34 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8cd900-5b1e-4955-a833-c36fcc1b388e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0b0481-d499-45ec-9a81-8d5857541cb3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 (non-flash)
Apr 14 18:58:34 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.542s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e.part /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e.converted" returned: 0 in 0.458s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dd496e-ace3-4d98-9795-d1ea3a12b12b]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzJxelVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "67624d128dc646f391e6eb4fc9ae0a565db19e8e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.613s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG nova.network.neutron [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Successfully created port: 9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "67624d128dc646f391e6eb4fc9ae0a565db19e8e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "67624d128dc646f391e6eb4fc9ae0a565db19e8e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e,backing_fmt=raw /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e,backing_fmt=raw /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk 1073741824" returned: 0 in 0.051s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "67624d128dc646f391e6eb4fc9ae0a565db19e8e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/67624d128dc646f391e6eb4fc9ae0a565db19e8e --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG nova.objects.instance [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'migration_context' on Instance uuid 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Ensure instance console log exists: /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.631s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] <== connect_volume: return (1634ms) {'type': 'block', 'scsi_wwn': '23263353766646337', 'path': '/dev/sde'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263353766646337', 'path': '/dev/sde'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'flavor' on Instance uuid 68af5668-55ba-4150-be95-b6861afc820d {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:58:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 18:58:35 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:58:35 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:58:35 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:58:35 user nova-compute[71308]:   <serial>c74300f0-2575-455e-93c8-8de79d10c378</serial>
Apr 14 18:58:35 user nova-compute[71308]: </disk>
Apr 14 18:58:35 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Successfully updated port: 9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquired lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.compute.manager [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received event network-changed-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.compute.manager [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Refreshing instance network info cache due to event network-changed-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] Acquiring lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] No VIF found with MAC fa:16:3e:4f:2a:4d, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7f2fa660-8aac-4e85-99a0-95e023d0467e tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.722s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.network.neutron [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Updating instance_info_cache with network_info: [{"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Releasing lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Instance network_info: |[{"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] Acquired lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.network.neutron [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Refreshing network info cache for port 9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Start _get_guest_xml network_info=[{"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='224c76199fa85c2e7f2f555c8c101a12',container_format='bare',created_at=2023-04-14T18:58:19Z,direct_url=<?>,disk_format='qcow2',id=b06b95d0-3f1e-4cfc-b707-9f58271dcb39,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-387267343',owner='921435d84194431c886ec1ed1848d4d6',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T18:58:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': 'b06b95d0-3f1e-4cfc-b707-9f58271dcb39'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:58:36 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:58:36 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='224c76199fa85c2e7f2f555c8c101a12',container_format='bare',created_at=2023-04-14T18:58:19Z,direct_url=<?>,disk_format='qcow2',id=b06b95d0-3f1e-4cfc-b707-9f58271dcb39,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-387267343',owner='921435d84194431c886ec1ed1848d4d6',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T18:58:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1760181806',display_name='tempest-TestStampPattern-server-1760181806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1760181806',id=31,image_ref='b06b95d0-3f1e-4cfc-b707-9f58271dcb39',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx8M4QjbAb47cqa0IIK3DFtHC++DW5qjEMCJfo5EDtvaO/cl4OHImq2UJzNJC1zQSEajn+k79i0pWkmV4FFQZ3qK1iN0DjaB8oxSduo8LZXNaMWp9839OvzlCknJnwL1A==',key_name='tempest-TestStampPattern-580300982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='921435d84194431c886ec1ed1848d4d6',ramdisk_id='',reservation_id='r-1378ur01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1feb4399-a5dc-43a7-ac78-4d22809e2737',image_min_disk='1',image_min_ram='0',image_owner_id='921435d84194431c886ec1ed1848d4d6',image_owner_project_name='tempest-TestStampPattern-251531447',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-251531447-project-member',image_user_id='9a9414d0c24643fdb162aad828c736bd',network_allocated='True',owner_project_name='tempest-TestStampPattern-251531447',owner_user_name='tempest-TestStampPattern-251531447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:58:33Z,user_data=None,user_id='9a9414d0c24643fdb162aad828c736bd',uuid=48e2cdcb-9b4a-458b-95d7-47ef29dd6b58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converting VIF {"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=9c30d673-dfd0-4bd2-ab60-3429b5cd3f92,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30d673-df') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.objects.instance [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'pci_devices' on Instance uuid 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:58:36 user nova-compute[71308]:   <uuid>48e2cdcb-9b4a-458b-95d7-47ef29dd6b58</uuid>
Apr 14 18:58:36 user nova-compute[71308]:   <name>instance-0000001f</name>
Apr 14 18:58:36 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:58:36 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:58:36 user nova-compute[71308]:   <metadata>
Apr 14 18:58:36 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:58:36 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:58:36 user nova-compute[71308]:       <nova:name>tempest-TestStampPattern-server-1760181806</nova:name>
Apr 14 18:58:36 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:58:36</nova:creationTime>
Apr 14 18:58:36 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:58:36 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:58:36 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:58:36 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:58:36 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:58:36 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:58:36 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:58:36 user nova-compute[71308]:       <nova:owner>
Apr 14 18:58:36 user nova-compute[71308]:         <nova:user uuid="9a9414d0c24643fdb162aad828c736bd">tempest-TestStampPattern-251531447-project-member</nova:user>
Apr 14 18:58:36 user nova-compute[71308]:         <nova:project uuid="921435d84194431c886ec1ed1848d4d6">tempest-TestStampPattern-251531447</nova:project>
Apr 14 18:58:36 user nova-compute[71308]:       </nova:owner>
Apr 14 18:58:36 user nova-compute[71308]:       <nova:root type="image" uuid="b06b95d0-3f1e-4cfc-b707-9f58271dcb39"/>
Apr 14 18:58:36 user nova-compute[71308]:       <nova:ports>
Apr 14 18:58:36 user nova-compute[71308]:         <nova:port uuid="9c30d673-dfd0-4bd2-ab60-3429b5cd3f92">
Apr 14 18:58:36 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 18:58:36 user nova-compute[71308]:         </nova:port>
Apr 14 18:58:36 user nova-compute[71308]:       </nova:ports>
Apr 14 18:58:36 user nova-compute[71308]:     </nova:instance>
Apr 14 18:58:36 user nova-compute[71308]:   </metadata>
Apr 14 18:58:36 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:58:36 user nova-compute[71308]:     <system>
Apr 14 18:58:36 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:58:36 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:58:36 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:58:36 user nova-compute[71308]:       <entry name="serial">48e2cdcb-9b4a-458b-95d7-47ef29dd6b58</entry>
Apr 14 18:58:36 user nova-compute[71308]:       <entry name="uuid">48e2cdcb-9b4a-458b-95d7-47ef29dd6b58</entry>
Apr 14 18:58:36 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:58:36 user nova-compute[71308]:     </system>
Apr 14 18:58:36 user nova-compute[71308]:   </sysinfo>
Apr 14 18:58:36 user nova-compute[71308]:   <os>
Apr 14 18:58:36 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:58:36 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:58:36 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:58:36 user nova-compute[71308]:   </os>
Apr 14 18:58:36 user nova-compute[71308]:   <features>
Apr 14 18:58:36 user nova-compute[71308]:     <acpi/>
Apr 14 18:58:36 user nova-compute[71308]:     <apic/>
Apr 14 18:58:36 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:58:36 user nova-compute[71308]:   </features>
Apr 14 18:58:36 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:58:36 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:58:36 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:58:36 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:58:36 user nova-compute[71308]:   </clock>
Apr 14 18:58:36 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:58:36 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:58:36 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:58:36 user nova-compute[71308]:   </cpu>
Apr 14 18:58:36 user nova-compute[71308]:   <devices>
Apr 14 18:58:36 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:58:36 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:58:36 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk"/>
Apr 14 18:58:36 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:58:36 user nova-compute[71308]:     </disk>
Apr 14 18:58:36 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:58:36 user nova-compute[71308]:       <mac address="fa:16:3e:58:b4:9a"/>
Apr 14 18:58:36 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:58:36 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:58:36 user nova-compute[71308]:       <target dev="tap9c30d673-df"/>
Apr 14 18:58:36 user nova-compute[71308]:     </interface>
Apr 14 18:58:36 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:58:36 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/console.log" append="off"/>
Apr 14 18:58:36 user nova-compute[71308]:     </serial>
Apr 14 18:58:36 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:58:36 user nova-compute[71308]:     <video>
Apr 14 18:58:36 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:58:36 user nova-compute[71308]:     </video>
Apr 14 18:58:36 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:58:36 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:58:36 user nova-compute[71308]:     </rng>
Apr 14 18:58:36 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:58:36 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:58:36 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:58:36 user nova-compute[71308]:     </memballoon>
Apr 14 18:58:36 user nova-compute[71308]:   </devices>
Apr 14 18:58:36 user nova-compute[71308]: </domain>
Apr 14 18:58:36 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1760181806',display_name='tempest-TestStampPattern-server-1760181806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1760181806',id=31,image_ref='b06b95d0-3f1e-4cfc-b707-9f58271dcb39',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx8M4QjbAb47cqa0IIK3DFtHC++DW5qjEMCJfo5EDtvaO/cl4OHImq2UJzNJC1zQSEajn+k79i0pWkmV4FFQZ3qK1iN0DjaB8oxSduo8LZXNaMWp9839OvzlCknJnwL1A==',key_name='tempest-TestStampPattern-580300982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='921435d84194431c886ec1ed1848d4d6',ramdisk_id='',reservation_id='r-1378ur01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1feb4399-a5dc-43a7-ac78-4d22809e2737',image_min_disk='1',image_min_ram='0',image_owner_id='921435d84194431c886ec1ed1848d4d6',image_owner_project_name='tempest-TestStampPattern-251531447',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-251531447-project-member',image_user_id='9a9414d0c24643fdb162aad828c736bd',network_allocated='True',owner_project_name='tempest-TestStampPattern-251531447',owner_user_name='tempest-TestStampPattern-251531447-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:58:33Z,user_data=None,user_id='9a9414d0c24643fdb162aad828c736bd',uuid=48e2cdcb-9b4a-458b-95d7-47ef29dd6b58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converting VIF {"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=9c30d673-dfd0-4bd2-ab60-3429b5cd3f92,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30d673-df') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG os_vif [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=9c30d673-dfd0-4bd2-ab60-3429b5cd3f92,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30d673-df') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c30d673-df, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c30d673-df, col_values=(('external_ids', {'iface-id': '9c30d673-dfd0-4bd2-ab60-3429b5cd3f92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:b4:9a', 'vm-uuid': '48e2cdcb-9b4a-458b-95d7-47ef29dd6b58'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:36 user nova-compute[71308]: INFO os_vif [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=9c30d673-dfd0-4bd2-ab60-3429b5cd3f92,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30d673-df')
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:58:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No VIF found with MAC fa:16:3e:58:b4:9a, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:58:37 user nova-compute[71308]: DEBUG nova.network.neutron [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Updated VIF entry in instance network info cache for port 9c30d673-dfd0-4bd2-ab60-3429b5cd3f92. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:58:37 user nova-compute[71308]: DEBUG nova.network.neutron [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Updating instance_info_cache with network_info: [{"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:58:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f6050988-08c1-4949-868f-0d3a07e80ccb req-b610da98-4951-43cf-bd0f-b5fca016ec5b service nova] Releasing lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:38 user nova-compute[71308]: INFO nova.compute.manager [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Detaching volume c74300f0-2575-455e-93c8-8de79d10c378
Apr 14 18:58:38 user nova-compute[71308]: INFO nova.virt.block_device [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Attempting to driver detach volume c74300f0-2575-455e-93c8-8de79d10c378 from mountpoint /dev/vdb
Apr 14 18:58:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Attempting to detach device vdb from instance 68af5668-55ba-4150-be95-b6861afc820d from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:58:38 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:58:38 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:58:38 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:58:38 user nova-compute[71308]:   <serial>c74300f0-2575-455e-93c8-8de79d10c378</serial>
Apr 14 18:58:38 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:58:38 user nova-compute[71308]: </disk>
Apr 14 18:58:38 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:58:38 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully detached device vdb from instance 68af5668-55ba-4150-be95-b6861afc820d from the persistent domain config.
Apr 14 18:58:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68af5668-55ba-4150-be95-b6861afc820d from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 18:58:38 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:58:38 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 18:58:38 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 18:58:38 user nova-compute[71308]:   <serial>c74300f0-2575-455e-93c8-8de79d10c378</serial>
Apr 14 18:58:38 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 18:58:38 user nova-compute[71308]: </disk>
Apr 14 18:58:38 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG nova.compute.manager [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received event network-vif-plugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:38 user nova-compute[71308]: DEBUG nova.compute.manager [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] No waiting events found dispatching network-vif-plugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:58:38 user nova-compute[71308]: WARNING nova.compute.manager [req-b153d6d5-c345-4853-8e34-8532e11703a3 req-2479520a-084e-4548-a219-be886d81872a service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received unexpected event network-vif-plugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance with vm_state building and task_state spawning.
Apr 14 18:58:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498719.2890801, 68af5668-55ba-4150-be95-b6861afc820d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68af5668-55ba-4150-be95-b6861afc820d {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 18:58:39 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully detached device vdb from instance 68af5668-55ba-4150-be95-b6861afc820d from the live domain config.
Apr 14 18:58:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzJxelVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:58:39 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c996d642-5cf9-48e9-b22e-9e2f7432193f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:58:39 user nova-compute[71308]: No targets found.
Apr 14 18:58:39 user nova-compute[71308]: iSNS:
Apr 14 18:58:39 user nova-compute[71308]: No targets found.
Apr 14 18:58:39 user nova-compute[71308]: STATIC:
Apr 14 18:58:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:58:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:58:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:58:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9
Apr 14 18:58:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:58:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:58:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378
Apr 14 18:58:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:58:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:58:39 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:58:39 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:58:39 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:58:39 user nova-compute[71308]: FIRMWARE:
Apr 14 18:58:39 user nova-compute[71308]: No targets found.
Apr 14 18:58:39 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:58:39 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:58:39 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ab5e55-a310-4dd9-a680-e977cc23d3ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9df55f-3a80-4039-a9e8-98495f9cc286]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:39 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:39 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:39 user nova-compute[71308]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 (non-flash)
Apr 14 18:58:39 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:39 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:39 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:39 user nova-compute[71308]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 (non-flash)
Apr 14 18:58:39 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22542dbbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378'): ({'sde'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Removing single pathed devices sde {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[908f9055-503d-4594-861f-33ea9f4168f2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc94af9-7b24-456f-bb30-85831fb15d39]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Flushing IO for device /dev/sde {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bcdffc-270a-4e72-9f8a-21c5e8d11798]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[18576e9c-212a-461e-85e8-ec2755a3019e]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f044700-cf85-4d50-accc-78cbabfb6ed0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[210db723-9c30-4a9d-a036-2c5da0ba47ae]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378, portal: 172.16.0.220,3260]
Apr 14 18:58:39 user nova-compute[71308]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378, portal: 172.16.0.220,3260] successful.
Apr 14 18:58:39 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c74300f0-2575-455e-93c8-8de79d10c378 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb48de6-94ed-42a2-9f40-22d81310e231]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] <== disconnect_volume: return (333ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:58:39 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:58:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received event network-vif-plugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:58:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] No waiting events found dispatching network-vif-plugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:58:40 user nova-compute[71308]: WARNING nova.compute.manager [req-5a16d76f-27db-41ee-8475-f462bca1319a req-a015906a-3272-42ea-b74f-b04503b18618 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received unexpected event network-vif-plugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance with vm_state building and task_state spawning.
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498721.2586792, 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:58:41 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] VM Resumed (Lifecycle Event)
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:58:41 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Instance spawned successfully.
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:58:41 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498721.261457, 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:58:41 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] VM Started (Lifecycle Event)
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:58:41 user nova-compute[71308]: INFO nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Took 8.08 seconds to spawn the instance on the hypervisor.
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:58:41 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:58:41 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:58:41 user nova-compute[71308]: INFO nova.compute.manager [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Took 8.98 seconds to build instance.
Apr 14 18:58:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35c21a60-0b58-4343-adc2-d1a9fca31aec tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.081s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:42 user nova-compute[71308]: DEBUG nova.objects.instance [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'flavor' on Instance uuid 68af5668-55ba-4150-be95-b6861afc820d {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:58:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-daa89cb0-b237-4308-9fd2-a133116533d4 tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.906s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "56097076-1e63-41ba-8331-be8ede06c537" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "56097076-1e63-41ba-8331-be8ede06c537" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:48 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:58:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:48 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:58:48 user nova-compute[71308]: INFO nova.compute.claims [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Claim successful on node user
Apr 14 18:58:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:48 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:58:48 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:58:49 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:58:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:58:49 user nova-compute[71308]: INFO nova.virt.block_device [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Booting with volume 84ea013c-1c59-46c4-b9be-9feb9dd5409d at /dev/vda
Apr 14 18:58:49 user nova-compute[71308]: DEBUG nova.policy [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG os_brick.utils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a38c4ec-b9ed-465a-b6ee-a09ebe45d03f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b15f0b-8f4b-42d3-8107-e801c29c3435]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4394c18-86a9-4196-9115-65e3b08f2286]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[50da6598-65ea-4aa4-b149-f239a7c41392]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 18:58:49 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 18:58:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2de031-021b-4453-aba7-07033026ad06]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG os_brick.utils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:58:49 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Updating existing volume attachment record: 8ebd02a9-a609-4f68-ac57-5d673be813f9 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 18:58:50 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Successfully created port: f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Successfully updated port: f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "refresh_cache-56097076-1e63-41ba-8331-be8ede06c537" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquired lock "refresh_cache-56097076-1e63-41ba-8331-be8ede06c537" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received event network-changed-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Refreshing instance network info cache due to event network-changed-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] Acquiring lock "refresh_cache-56097076-1e63-41ba-8331-be8ede06c537" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Updating instance_info_cache with network_info: [{"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Releasing lock "refresh_cache-56097076-1e63-41ba-8331-be8ede06c537" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Instance network_info: |[{"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] Acquired lock "refresh_cache-56097076-1e63-41ba-8331-be8ede06c537" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Refreshing network info cache for port f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Updated VIF entry in instance network info cache for port f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Updating instance_info_cache with network_info: [{"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-200a5428-121b-48e2-bb21-54d3a7b6b19d req-dec97a09-7061-4383-b02e-4b27c9136336 service nova] Releasing lock "refresh_cache-56097076-1e63-41ba-8331-be8ede06c537" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:58:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:58:56 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Creating image(s)
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Ensure instance console log exists: /opt/stack/data/nova/instances/56097076-1e63-41ba-8331-be8ede06c537/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Start _get_guest_xml network_info=[{"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '8ebd02a9-a609-4f68-ac57-5d673be813f9', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWQZRKwb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56097076-1e63-41ba-8331-be8ede06c537', 'attached_at': '', 'detached_at': '', 'volume_id': '84ea013c-1c59-46c4-b9be-9feb9dd5409d', 'serial': '84ea013c-1c59-46c4-b9be-9feb9dd5409d'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:58:56 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:58:56 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWQZRKwb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:58:56 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:58:56 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:58:56 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[783b2c5a-d1ad-4f81-8ca7-95049b4945cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 18:58:56 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1493f746-f726-41a4-a027-6b1fe6694e1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d] added
Apr 14 18:58:56 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c3222d-3b80-4d8d-b378-ffde0c8be74c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3758d248-cab5-43fa-adaa-7e92e43642f9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWQZRKwb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWQZRKwb" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c144e7-2058-4782-a144-56941c11a8f1]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWQZRKwb'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[324ef75b-9ca8-414f-8004-867f58849902]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aea4e0-54e6-45b7-941b-d1a6ab5d4c79]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:56 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:56 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:56 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:56 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:56 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:56 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9e4030-93fa-4253-b2af-6e4b9ac6d80a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d, portal: 172.16.0.220,3260]
Apr 14 18:58:56 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d, portal: 172.16.0.220,3260] successful.
Apr 14 18:58:56 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d664385-42fd-4e6c-ab65-baede7315c7d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:58:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6f3c39-7f9a-4506-be8f-c0a474f668aa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:57 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:57 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:57 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 18:58:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:58:57 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:58:57 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:58:57 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 18:58:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c16e69-6bda-47cb-86ca-a774f53a8f41]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:58:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWQZRKwb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23964343339396331', 'path': '/dev/sde'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964343339396331', 'path': '/dev/sde'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-889981772',display_name='tempest-TestVolumeBootPattern-volume-backed-server-889981772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-889981772',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-20efi3zr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:58:49Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=56097076-1e63-41ba-8331-be8ede06c537,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:1c,bridge_name='br-int',has_traffic_filtering=True,id=f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28ad1a5-c4') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.objects.instance [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'pci_devices' on Instance uuid 56097076-1e63-41ba-8331-be8ede06c537 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:58:58 user nova-compute[71308]:   <uuid>56097076-1e63-41ba-8331-be8ede06c537</uuid>
Apr 14 18:58:58 user nova-compute[71308]:   <name>instance-00000020</name>
Apr 14 18:58:58 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:58:58 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:58:58 user nova-compute[71308]:   <metadata>
Apr 14 18:58:58 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:58:58 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:58:58 user nova-compute[71308]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-889981772</nova:name>
Apr 14 18:58:58 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:58:56</nova:creationTime>
Apr 14 18:58:58 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:58:58 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:58:58 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:58:58 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:58:58 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:58:58 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:58:58 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:58:58 user nova-compute[71308]:       <nova:owner>
Apr 14 18:58:58 user nova-compute[71308]:         <nova:user uuid="fc3bed70703a49c8bdec2f50193c7f70">tempest-TestVolumeBootPattern-1560263906-project-member</nova:user>
Apr 14 18:58:58 user nova-compute[71308]:         <nova:project uuid="72d2bf68325a4a18934a8403571c24bb">tempest-TestVolumeBootPattern-1560263906</nova:project>
Apr 14 18:58:58 user nova-compute[71308]:       </nova:owner>
Apr 14 18:58:58 user nova-compute[71308]:       <nova:ports>
Apr 14 18:58:58 user nova-compute[71308]:         <nova:port uuid="f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a">
Apr 14 18:58:58 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 18:58:58 user nova-compute[71308]:         </nova:port>
Apr 14 18:58:58 user nova-compute[71308]:       </nova:ports>
Apr 14 18:58:58 user nova-compute[71308]:     </nova:instance>
Apr 14 18:58:58 user nova-compute[71308]:   </metadata>
Apr 14 18:58:58 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:58:58 user nova-compute[71308]:     <system>
Apr 14 18:58:58 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:58:58 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:58:58 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:58:58 user nova-compute[71308]:       <entry name="serial">56097076-1e63-41ba-8331-be8ede06c537</entry>
Apr 14 18:58:58 user nova-compute[71308]:       <entry name="uuid">56097076-1e63-41ba-8331-be8ede06c537</entry>
Apr 14 18:58:58 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:58:58 user nova-compute[71308]:     </system>
Apr 14 18:58:58 user nova-compute[71308]:   </sysinfo>
Apr 14 18:58:58 user nova-compute[71308]:   <os>
Apr 14 18:58:58 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:58:58 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:58:58 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:58:58 user nova-compute[71308]:   </os>
Apr 14 18:58:58 user nova-compute[71308]:   <features>
Apr 14 18:58:58 user nova-compute[71308]:     <acpi/>
Apr 14 18:58:58 user nova-compute[71308]:     <apic/>
Apr 14 18:58:58 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:58:58 user nova-compute[71308]:   </features>
Apr 14 18:58:58 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:58:58 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:58:58 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:58:58 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:58:58 user nova-compute[71308]:   </clock>
Apr 14 18:58:58 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:58:58 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:58:58 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:58:58 user nova-compute[71308]:   </cpu>
Apr 14 18:58:58 user nova-compute[71308]:   <devices>
Apr 14 18:58:58 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:58:58 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:58:58 user nova-compute[71308]:       <source dev="/dev/sde"/>
Apr 14 18:58:58 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:58:58 user nova-compute[71308]:       <serial>84ea013c-1c59-46c4-b9be-9feb9dd5409d</serial>
Apr 14 18:58:58 user nova-compute[71308]:     </disk>
Apr 14 18:58:58 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:58:58 user nova-compute[71308]:       <mac address="fa:16:3e:f2:19:1c"/>
Apr 14 18:58:58 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:58:58 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:58:58 user nova-compute[71308]:       <target dev="tapf28ad1a5-c4"/>
Apr 14 18:58:58 user nova-compute[71308]:     </interface>
Apr 14 18:58:58 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:58:58 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/56097076-1e63-41ba-8331-be8ede06c537/console.log" append="off"/>
Apr 14 18:58:58 user nova-compute[71308]:     </serial>
Apr 14 18:58:58 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:58:58 user nova-compute[71308]:     <video>
Apr 14 18:58:58 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:58:58 user nova-compute[71308]:     </video>
Apr 14 18:58:58 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:58:58 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:58:58 user nova-compute[71308]:     </rng>
Apr 14 18:58:58 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:58:58 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:58:58 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:58:58 user nova-compute[71308]:     </memballoon>
Apr 14 18:58:58 user nova-compute[71308]:   </devices>
Apr 14 18:58:58 user nova-compute[71308]: </domain>
Apr 14 18:58:58 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-889981772',display_name='tempest-TestVolumeBootPattern-volume-backed-server-889981772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-889981772',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-20efi3zr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:58:49Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=56097076-1e63-41ba-8331-be8ede06c537,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:1c,bridge_name='br-int',has_traffic_filtering=True,id=f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28ad1a5-c4') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG os_vif [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:1c,bridge_name='br-int',has_traffic_filtering=True,id=f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28ad1a5-c4') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf28ad1a5-c4, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf28ad1a5-c4, col_values=(('external_ids', {'iface-id': 'f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:19:1c', 'vm-uuid': '56097076-1e63-41ba-8331-be8ede06c537'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:58 user nova-compute[71308]: INFO os_vif [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:1c,bridge_name='br-int',has_traffic_filtering=True,id=f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28ad1a5-c4')
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No VIF found with MAC fa:16:3e:f2:19:1c, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:58:58 user nova-compute[71308]: INFO nova.compute.claims [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Claim successful on node user
Apr 14 18:58:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:58:58 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:58:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.policy [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8713ed85ffb4446847f5ded4bc2e399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e60e8abd123e414f847c68ba72894689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:58:59 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Creating image(s)
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk 1073741824" returned: 0 in 0.052s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.212s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Cannot resize image /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'migration_context' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Ensure instance console log exists: /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Successfully created port: dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:58:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:58:59 user nova-compute[71308]: INFO nova.compute.manager [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Terminating instance
Apr 14 18:58:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received event network-vif-plugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] Acquiring lock "56097076-1e63-41ba-8331-be8ede06c537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] No waiting events found dispatching network-vif-plugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:00 user nova-compute[71308]: WARNING nova.compute.manager [req-6f1dc242-1ca0-4cd1-a5ed-8c11b83f1fb8 req-f40e37dc-639d-4a53-baa9-dabf70dd8cec service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received unexpected event network-vif-plugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance with vm_state building and task_state spawning.
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Successfully updated port: dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquired lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-changed-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Refreshing instance network info cache due to event network-changed-dff6b65b-1de5-4cb6-b5dd-778d05760cbd. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] Acquiring lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:59:00 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Instance destroyed successfully.
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.objects.instance [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'resources' on Instance uuid aa09363f-435d-4fa8-9f11-db0c3f4e08be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T18:46:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1477481393',display_name='tempest-ServerActionsTestJSON-server-1006128169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1477481393',id=5,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:56:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-b2sqsg2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=aa09363f-435d-4fa8-9f11-db0c3f4e08be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "address": "fa:16:3e:11:69:69", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2afe22e1-00", "ovs_interfaceid": "2afe22e1-0044-47e2-ba5f-e1d9fd6d0620", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_vif [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2afe22e1-00, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:59:00 user nova-compute[71308]: INFO os_vif [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:69:69,bridge_name='br-int',has_traffic_filtering=True,id=2afe22e1-0044-47e2-ba5f-e1d9fd6d0620,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2afe22e1-00')
Apr 14 18:59:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bVmnceLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:59:00 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6ce85-dbe4-4e3e-b762-908f8ed437e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 18:59:00 user nova-compute[71308]: No targets found.
Apr 14 18:59:00 user nova-compute[71308]: iSNS:
Apr 14 18:59:00 user nova-compute[71308]: No targets found.
Apr 14 18:59:00 user nova-compute[71308]: STATIC:
Apr 14 18:59:00 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe
Apr 14 18:59:00 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:59:00 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:59:00 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d
Apr 14 18:59:00 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:59:00 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:59:00 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9
Apr 14 18:59:00 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:59:00 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:59:00 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 18:59:00 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 18:59:00 user nova-compute[71308]:                 Iface Name: default
Apr 14 18:59:00 user nova-compute[71308]: FIRMWARE:
Apr 14 18:59:00 user nova-compute[71308]: No targets found.
Apr 14 18:59:00 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 18:59:00 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 18:59:00 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1d7bd5-3878-47d0-9d60-7848768f59c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7317043-cade-474a-9d1f-b2bd52af4b28]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:59:00 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:59:00 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:59:00 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 18:59:00 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:59:00 user nova-compute[71308]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe (non-flash)
Apr 14 18:59:00 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:59:00 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 18:59:00 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22306439a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c895189c-6a9c-4430-8ac8-3333f261930a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f10acb4-e9a8-48a3-9382-64d3ab2bd214]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8f51bd-85c2-487c-8f90-5923f2247da9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70ad9be-61ef-4149-9617-48736a4441de]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 18:59:00 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24b7a25-97d8-4c5e-87d5-c645796b6fe2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating instance_info_cache with network_info: [{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8178159a-7742-43f8-bdc3-804ace0d49b3]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260]
Apr 14 18:59:01 user nova-compute[71308]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe, portal: 172.16.0.220,3260] successful.
Apr 14 18:59:01 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Releasing lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Instance network_info: |[{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] Acquired lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.network.neutron [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Refreshing network info cache for port dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Start _get_guest_xml network_info=[{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:59:01 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:01 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-878359626',display_name='tempest-ServerRescueNegativeTestJSON-server-878359626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-878359626',id=33,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsV7S4Lu7EScb7Ca1HXXWHMkfNibGLUsHaVxGGFEiPOu+DZdxz7O+eYdDkk0eqIIMAOS8zIzZ1Dx0oJrzQLMfBVS8ZQb5vqX9QOfeUkQuI1qS8pmjCXzIvfDogAaOvDEA==',key_name='tempest-keypair-126127202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-6n0xph1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=05891511-e84c-4fe3-a688-edcc27849d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4f:50,bridge_name='br-int',has_traffic_filtering=True,id=dff6b65b-1de5-4cb6-b5dd-778d05760cbd,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff6b65b-1d') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'pci_devices' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aca5780-bd08-43d5-af3e-b06f7501fdbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[302e0bf0-712a-4758-aadc-55eb4ab4c5e9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== disconnect_volume: return (391ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 18:59:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Deleting instance files /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be_del
Apr 14 18:59:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Deletion of /opt/stack/data/nova/instances/aa09363f-435d-4fa8-9f11-db0c3f4e08be_del complete
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:59:01 user nova-compute[71308]:   <uuid>05891511-e84c-4fe3-a688-edcc27849d58</uuid>
Apr 14 18:59:01 user nova-compute[71308]:   <name>instance-00000021</name>
Apr 14 18:59:01 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:59:01 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:59:01 user nova-compute[71308]:   <metadata>
Apr 14 18:59:01 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:59:01 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:59:01 user nova-compute[71308]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-878359626</nova:name>
Apr 14 18:59:01 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:59:01</nova:creationTime>
Apr 14 18:59:01 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:59:01 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:59:01 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:59:01 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:59:01 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:59:01 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:59:01 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:59:01 user nova-compute[71308]:       <nova:owner>
Apr 14 18:59:01 user nova-compute[71308]:         <nova:user uuid="c8713ed85ffb4446847f5ded4bc2e399">tempest-ServerRescueNegativeTestJSON-1174646715-project-member</nova:user>
Apr 14 18:59:01 user nova-compute[71308]:         <nova:project uuid="e60e8abd123e414f847c68ba72894689">tempest-ServerRescueNegativeTestJSON-1174646715</nova:project>
Apr 14 18:59:01 user nova-compute[71308]:       </nova:owner>
Apr 14 18:59:01 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:59:01 user nova-compute[71308]:       <nova:ports>
Apr 14 18:59:01 user nova-compute[71308]:         <nova:port uuid="dff6b65b-1de5-4cb6-b5dd-778d05760cbd">
Apr 14 18:59:01 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 18:59:01 user nova-compute[71308]:         </nova:port>
Apr 14 18:59:01 user nova-compute[71308]:       </nova:ports>
Apr 14 18:59:01 user nova-compute[71308]:     </nova:instance>
Apr 14 18:59:01 user nova-compute[71308]:   </metadata>
Apr 14 18:59:01 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:59:01 user nova-compute[71308]:     <system>
Apr 14 18:59:01 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:59:01 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:59:01 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:59:01 user nova-compute[71308]:       <entry name="serial">05891511-e84c-4fe3-a688-edcc27849d58</entry>
Apr 14 18:59:01 user nova-compute[71308]:       <entry name="uuid">05891511-e84c-4fe3-a688-edcc27849d58</entry>
Apr 14 18:59:01 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:59:01 user nova-compute[71308]:     </system>
Apr 14 18:59:01 user nova-compute[71308]:   </sysinfo>
Apr 14 18:59:01 user nova-compute[71308]:   <os>
Apr 14 18:59:01 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:59:01 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:59:01 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:59:01 user nova-compute[71308]:   </os>
Apr 14 18:59:01 user nova-compute[71308]:   <features>
Apr 14 18:59:01 user nova-compute[71308]:     <acpi/>
Apr 14 18:59:01 user nova-compute[71308]:     <apic/>
Apr 14 18:59:01 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:59:01 user nova-compute[71308]:   </features>
Apr 14 18:59:01 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:59:01 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:59:01 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:59:01 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:59:01 user nova-compute[71308]:   </clock>
Apr 14 18:59:01 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:59:01 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:59:01 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:59:01 user nova-compute[71308]:   </cpu>
Apr 14 18:59:01 user nova-compute[71308]:   <devices>
Apr 14 18:59:01 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:59:01 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:59:01 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk"/>
Apr 14 18:59:01 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:59:01 user nova-compute[71308]:     </disk>
Apr 14 18:59:01 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:59:01 user nova-compute[71308]:       <mac address="fa:16:3e:27:4f:50"/>
Apr 14 18:59:01 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:59:01 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:59:01 user nova-compute[71308]:       <target dev="tapdff6b65b-1d"/>
Apr 14 18:59:01 user nova-compute[71308]:     </interface>
Apr 14 18:59:01 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:59:01 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/console.log" append="off"/>
Apr 14 18:59:01 user nova-compute[71308]:     </serial>
Apr 14 18:59:01 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:59:01 user nova-compute[71308]:     <video>
Apr 14 18:59:01 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:59:01 user nova-compute[71308]:     </video>
Apr 14 18:59:01 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:59:01 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:59:01 user nova-compute[71308]:     </rng>
Apr 14 18:59:01 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:59:01 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:59:01 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:59:01 user nova-compute[71308]:     </memballoon>
Apr 14 18:59:01 user nova-compute[71308]:   </devices>
Apr 14 18:59:01 user nova-compute[71308]: </domain>
Apr 14 18:59:01 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-878359626',display_name='tempest-ServerRescueNegativeTestJSON-server-878359626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-878359626',id=33,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsV7S4Lu7EScb7Ca1HXXWHMkfNibGLUsHaVxGGFEiPOu+DZdxz7O+eYdDkk0eqIIMAOS8zIzZ1Dx0oJrzQLMfBVS8ZQb5vqX9QOfeUkQuI1qS8pmjCXzIvfDogAaOvDEA==',key_name='tempest-keypair-126127202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-6n0xph1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=05891511-e84c-4fe3-a688-edcc27849d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:4f:50,bridge_name='br-int',has_traffic_filtering=True,id=dff6b65b-1de5-4cb6-b5dd-778d05760cbd,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff6b65b-1d') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG os_vif [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4f:50,bridge_name='br-int',has_traffic_filtering=True,id=dff6b65b-1de5-4cb6-b5dd-778d05760cbd,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff6b65b-1d') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdff6b65b-1d, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdff6b65b-1d, col_values=(('external_ids', {'iface-id': 'dff6b65b-1de5-4cb6-b5dd-778d05760cbd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:4f:50', 'vm-uuid': '05891511-e84c-4fe3-a688-edcc27849d58'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:01 user nova-compute[71308]: INFO os_vif [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:4f:50,bridge_name='br-int',has_traffic_filtering=True,id=dff6b65b-1de5-4cb6-b5dd-778d05760cbd,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff6b65b-1d')
Apr 14 18:59:01 user nova-compute[71308]: INFO nova.compute.manager [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Took 1.33 seconds to destroy the instance on the hypervisor.
Apr 14 18:59:01 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No VIF found with MAC fa:16:3e:27:4f:50, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498741.96982, 56097076-1e63-41ba-8331-be8ede06c537 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:01 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 56097076-1e63-41ba-8331-be8ede06c537] VM Resumed (Lifecycle Event)
Apr 14 18:59:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Instance spawned successfully.
Apr 14 18:59:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:02 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 56097076-1e63-41ba-8331-be8ede06c537] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498741.9708984, 56097076-1e63-41ba-8331-be8ede06c537 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:02 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 56097076-1e63-41ba-8331-be8ede06c537] VM Started (Lifecycle Event)
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:02 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 56097076-1e63-41ba-8331-be8ede06c537] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:59:02 user nova-compute[71308]: INFO nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Took 5.47 seconds to spawn the instance on the hypervisor.
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:02 user nova-compute[71308]: INFO nova.compute.manager [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Took 13.91 seconds to build instance.
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1bd386ba-deec-4d0f-a4e4-d899d2cba641 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "56097076-1e63-41ba-8331-be8ede06c537" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.007s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received event network-vif-plugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Acquiring lock "56097076-1e63-41ba-8331-be8ede06c537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] No waiting events found dispatching network-vif-plugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:02 user nova-compute[71308]: WARNING nova.compute.manager [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received unexpected event network-vif-plugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance with vm_state active and task_state None.
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-unplugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Acquiring lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] No waiting events found dispatching network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:02 user nova-compute[71308]: WARNING nova.compute.manager [req-0cc785cf-b506-47ee-b64c-cd9c8ff8e12c req-b5e16302-6fde-4ba5-8ece-7e56b4ef4914 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received unexpected event network-vif-plugged-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 for instance with vm_state active and task_state deleting.
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.network.neutron [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updated VIF entry in instance network info cache for port dff6b65b-1de5-4cb6-b5dd-778d05760cbd. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.network.neutron [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating instance_info_cache with network_info: [{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-01f2d25d-163b-4a12-b247-17fc92a39f51 req-4ffb4a77-194c-47ad-87d8-5742bc9e2ef8 service nova] Releasing lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:59:02 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Took 1.59 seconds to deallocate network for instance.
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-8dbdfff1-b1fb-435a-83df-571c864b996a req-deebf96d-5a88-4520-add9-429d9bd6c879 service nova] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Received event network-vif-deleted-2afe22e1-0044-47e2-ba5f-e1d9fd6d0620 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:02 user nova-compute[71308]: WARNING nova.compute.manager [req-83a39602-8d87-426c-a10b-6fc875f8ea0a req-2c3d1fba-6635-42f6-b4f4-e9b9d886578d service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state building and task_state spawning.
Apr 14 18:59:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:03 user nova-compute[71308]: INFO nova.compute.manager [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Took 0.97 seconds to detach 1 volumes for instance.
Apr 14 18:59:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:04 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:59:04 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:59:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:04 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Deleted allocations for instance aa09363f-435d-4fa8-9f11-db0c3f4e08be
Apr 14 18:59:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-27e99476-d6cb-4ac5-bb24-fbec995868c7 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "aa09363f-435d-4fa8-9f11-db0c3f4e08be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.577s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:59:04 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498744.9906664, 05891511-e84c-4fe3-a688-edcc27849d58 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:04 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] VM Resumed (Lifecycle Event)
Apr 14 18:59:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:59:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:59:05 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Instance spawned successfully.
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.compute.manager [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.compute.manager [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:05 user nova-compute[71308]: WARNING nova.compute.manager [req-99c83b97-3143-462d-be41-6f41c5cdea78 req-417534c1-0306-45dc-84c7-302b381cf9e5 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state building and task_state spawning.
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498744.9917274, 05891511-e84c-4fe3-a688-edcc27849d58 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] VM Started (Lifecycle Event)
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:59:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Took 6.08 seconds to spawn the instance on the hypervisor.
Apr 14 18:59:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Took 6.92 seconds to build instance.
Apr 14 18:59:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d5df124c-30ac-4f27-938e-ccc77bf4bebf tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.118s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:06 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:59:07 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:59:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 18:59:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:08 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquired lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'info_cache' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updating instance_info_cache with network_info: [{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Releasing lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:59:10 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance destroyed successfully.
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'resources' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1892211249',display_name='tempest-AttachVolumeTestJSON-server-1892211249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1892211249',id=20,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA==',key_name='tempest-keypair-1957519464',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-h1jd70xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=0050e6bb-0b53-4fdc-8437-16b94ee79fa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG os_vif [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd49e6c-3f, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:59:10 user nova-compute[71308]: INFO os_vif [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f')
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Start _get_guest_xml network_info=[{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'numa_topology' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:10 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:10 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:59:10 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1892211249',display_name='tempest-AttachVolumeTestJSON-server-1892211249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1892211249',id=20,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA==',key_name='tempest-keypair-1957519464',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-h1jd70xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=0050e6bb-0b53-4fdc-8437-16b94ee79fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'pci_devices' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:59:11 user nova-compute[71308]:   <uuid>0050e6bb-0b53-4fdc-8437-16b94ee79fa4</uuid>
Apr 14 18:59:11 user nova-compute[71308]:   <name>instance-00000014</name>
Apr 14 18:59:11 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:59:11 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:59:11 user nova-compute[71308]:   <metadata>
Apr 14 18:59:11 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:59:11 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:59:11 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeTestJSON-server-1892211249</nova:name>
Apr 14 18:59:11 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:59:10</nova:creationTime>
Apr 14 18:59:11 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:59:11 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:59:11 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:59:11 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:59:11 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:59:11 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:59:11 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:59:11 user nova-compute[71308]:       <nova:owner>
Apr 14 18:59:11 user nova-compute[71308]:         <nova:user uuid="9f90c8f23e3b42a98fdb9261db65f547">tempest-AttachVolumeTestJSON-1126291015-project-member</nova:user>
Apr 14 18:59:11 user nova-compute[71308]:         <nova:project uuid="edf25bcc0dea4d3eb1284e8995eb3466">tempest-AttachVolumeTestJSON-1126291015</nova:project>
Apr 14 18:59:11 user nova-compute[71308]:       </nova:owner>
Apr 14 18:59:11 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:59:11 user nova-compute[71308]:       <nova:ports>
Apr 14 18:59:11 user nova-compute[71308]:         <nova:port uuid="2dd49e6c-3f3a-4124-aff8-a4a4e898cf21">
Apr 14 18:59:11 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 18:59:11 user nova-compute[71308]:         </nova:port>
Apr 14 18:59:11 user nova-compute[71308]:       </nova:ports>
Apr 14 18:59:11 user nova-compute[71308]:     </nova:instance>
Apr 14 18:59:11 user nova-compute[71308]:   </metadata>
Apr 14 18:59:11 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:59:11 user nova-compute[71308]:     <system>
Apr 14 18:59:11 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:59:11 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:59:11 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:59:11 user nova-compute[71308]:       <entry name="serial">0050e6bb-0b53-4fdc-8437-16b94ee79fa4</entry>
Apr 14 18:59:11 user nova-compute[71308]:       <entry name="uuid">0050e6bb-0b53-4fdc-8437-16b94ee79fa4</entry>
Apr 14 18:59:11 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:59:11 user nova-compute[71308]:     </system>
Apr 14 18:59:11 user nova-compute[71308]:   </sysinfo>
Apr 14 18:59:11 user nova-compute[71308]:   <os>
Apr 14 18:59:11 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:59:11 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:59:11 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:59:11 user nova-compute[71308]:   </os>
Apr 14 18:59:11 user nova-compute[71308]:   <features>
Apr 14 18:59:11 user nova-compute[71308]:     <acpi/>
Apr 14 18:59:11 user nova-compute[71308]:     <apic/>
Apr 14 18:59:11 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:59:11 user nova-compute[71308]:   </features>
Apr 14 18:59:11 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:59:11 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:59:11 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:59:11 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:59:11 user nova-compute[71308]:   </clock>
Apr 14 18:59:11 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:59:11 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:59:11 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:59:11 user nova-compute[71308]:   </cpu>
Apr 14 18:59:11 user nova-compute[71308]:   <devices>
Apr 14 18:59:11 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:59:11 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:59:11 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk"/>
Apr 14 18:59:11 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:59:11 user nova-compute[71308]:     </disk>
Apr 14 18:59:11 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:59:11 user nova-compute[71308]:       <mac address="fa:16:3e:18:06:fd"/>
Apr 14 18:59:11 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:59:11 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:59:11 user nova-compute[71308]:       <target dev="tap2dd49e6c-3f"/>
Apr 14 18:59:11 user nova-compute[71308]:     </interface>
Apr 14 18:59:11 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:59:11 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/console.log" append="off"/>
Apr 14 18:59:11 user nova-compute[71308]:     </serial>
Apr 14 18:59:11 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:59:11 user nova-compute[71308]:     <video>
Apr 14 18:59:11 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:59:11 user nova-compute[71308]:     </video>
Apr 14 18:59:11 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:59:11 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:59:11 user nova-compute[71308]:     </rng>
Apr 14 18:59:11 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:59:11 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:59:11 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:59:11 user nova-compute[71308]:     </memballoon>
Apr 14 18:59:11 user nova-compute[71308]:   </devices>
Apr 14 18:59:11 user nova-compute[71308]: </domain>
Apr 14 18:59:11 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Cannot resize image /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'migration_context' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1892211249',display_name='tempest-AttachVolumeTestJSON-server-1892211249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1892211249',id=20,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA==',key_name='tempest-keypair-1957519464',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-h1jd70xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=0050e6bb-0b53-4fdc-8437-16b94ee79fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG os_vif [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd49e6c-3f, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2dd49e6c-3f, col_values=(('external_ids', {'iface-id': '2dd49e6c-3f3a-4124-aff8-a4a4e898cf21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:06:fd', 'vm-uuid': '0050e6bb-0b53-4fdc-8437-16b94ee79fa4'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:11 user nova-compute[71308]: INFO os_vif [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f')
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:13 user nova-compute[71308]: WARNING nova.compute.manager [req-ef870443-93d5-4f8a-8733-c345fe7940cd req-33efe537-51fc-45e7-8d7c-702b25ec6551 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state stopped and task_state powering-on.
Apr 14 18:59:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 18:59:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498755.3734174, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:15 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] VM Resumed (Lifecycle Event)
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.manager [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.manager [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:15 user nova-compute[71308]: WARNING nova.compute.manager [req-1791ec26-0d90-4609-b711-db13eb996dc1 req-eec06436-97d4-4514-8eff-8312dd5efefc service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state stopped and task_state powering-on.
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7424MB free_disk=26.160564422607422GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance rebooted successfully.
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ae6c21d-1adc-47ce-b692-508951710ba2 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498740.7005477, aa09363f-435d-4fa8-9f11-db0c3f4e08be => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:15 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] VM Stopped (Lifecycle Event)
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-39acfe45-2030-4481-91eb-cff339dae276 None None] [instance: aa09363f-435d-4fa8-9f11-db0c3f4e08be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:15 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498755.374679, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:15 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] VM Started (Lifecycle Event)
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:15 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 68af5668-55ba-4150-be95-b6861afc820d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 56097076-1e63-41ba-8331-be8ede06c537 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 05891511-e84c-4fe3-a688-edcc27849d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 18:59:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 18:59:16 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:59:16 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:59:16 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 18:59:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updating instance_info_cache with network_info: [{"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-0050e6bb-0b53-4fdc-8437-16b94ee79fa4" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:59:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 18:59:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:25 user nova-compute[71308]: INFO nova.compute.manager [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Rescuing
Apr 14 18:59:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:59:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquired lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:59:25 user nova-compute[71308]: DEBUG nova.network.neutron [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG nova.network.neutron [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Updating instance_info_cache with network_info: [{"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Releasing lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-unplugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-unplugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:26 user nova-compute[71308]: WARNING nova.compute.manager [req-d5400cc5-0263-4812-a1fa-6898eb4e42af req-696430ba-926e-4f0d-bbed-bed0c1de3459 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-unplugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state active and task_state rescuing.
Apr 14 18:59:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:27 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Instance destroyed successfully.
Apr 14 18:59:27 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Attempting a stable device rescue
Apr 14 18:59:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71308) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 18:59:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Instance directory exists: not creating {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 18:59:27 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Creating image(s)
Apr 14 18:59:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "/opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "/opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:27 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "aaf1ddd1c050161fb4eed9080273295d1a5be199" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "aaf1ddd1c050161fb4eed9080273295d1a5be199" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199.part --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG nova.virt.images [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] 38668399-fef1-4faf-adc6-9795d25acf37 was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199.part /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199.part /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199.converted" returned: 0 in 0.382s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:28 user nova-compute[71308]: INFO nova.compute.manager [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Terminating instance
Apr 14 18:59:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "aaf1ddd1c050161fb4eed9080273295d1a5be199" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.506s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "aaf1ddd1c050161fb4eed9080273295d1a5be199" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "aaf1ddd1c050161fb4eed9080273295d1a5be199" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:28 user nova-compute[71308]: WARNING nova.compute.manager [req-6c92ea6e-3ecc-47a3-b958-45ce415969a7 req-632ae1bd-847d-4115-9fe6-75dcfd6bbb2a service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state active and task_state rescuing.
Apr 14 18:59:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199 --force-share --output=json" returned: 0 in 0.161s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199,backing_fmt=raw /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aaf1ddd1c050161fb4eed9080273295d1a5be199,backing_fmt=raw /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue" returned: 0 in 0.054s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "aaf1ddd1c050161fb4eed9080273295d1a5be199" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'migration_context' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Start _get_guest_xml network_info=[{"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "vif_mac": "fa:16:3e:bc:fb:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '38668399-fef1-4faf-adc6-9795d25acf37', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '6a462f5e-74d6-41b5-84ff-c6bbf430a866', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyaEeBsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1', 'attached_at': '', 'detached_at': '', 'volume_id': '30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 'serial': '30e0fe34-9aba-4c9b-9fa6-18333cbc07b9'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'resources' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'numa_topology' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:29 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:29 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyaEeBsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 18:59:29 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:59:29 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 18:59:29 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee883bb4-9378-4579-90ce-7e510c1e92c5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JyaEeBsX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 18:59:29 user nova-compute[71308]: node.name = iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9
Apr 14 18:59:29 user nova-compute[71308]: node.tpgt = -1
Apr 14 18:59:29 user nova-compute[71308]: node.startup = automatic
Apr 14 18:59:29 user nova-compute[71308]: node.leading_login = No
Apr 14 18:59:29 user nova-compute[71308]: iface.iscsi_ifacename = default
Apr 14 18:59:29 user nova-compute[71308]: iface.net_ifacename = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.ipaddress = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.prefix_len = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.hwaddress = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.transport_name = tcp
Apr 14 18:59:29 user nova-compute[71308]: iface.initiatorname = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.state = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.vlan_id = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.vlan_priority = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.vlan_state = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.iface_num = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.mtu = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.port = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.bootproto = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.subnet_mask = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.gateway = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.dhcp_alt_client_id = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.dhcp_dns = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.dhcp_learn_iqn = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.dhcp_vendor_id_state = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.dhcp_vendor_id = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.dhcp_slp_da = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.fragmentation = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.gratuitous_arp = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.incoming_forwarding = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.tos_state = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.tos = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.ttl = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.delayed_ack = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.tcp_nagle = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.tcp_wsf_state = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.tcp_wsf = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.tcp_timer_scale = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.tcp_timestamp = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.redirect = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.def_task_mgmt_timeout = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.header_digest = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.data_digest = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.immediate_data = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.initial_r2t = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.data_seq_inorder = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.data_pdu_inorder = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.erl = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.max_receive_data_len = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.first_burst_len = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.max_outstanding_r2t = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.max_burst_len = 0
Apr 14 18:59:29 user nova-compute[71308]: iface.chap_auth = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.bidi_chap = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.strict_login_compliance = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.discovery_auth = <empty>
Apr 14 18:59:29 user nova-compute[71308]: iface.discovery_logout = <empty>
Apr 14 18:59:29 user nova-compute[71308]: node.discovery_address = <empty>
Apr 14 18:59:29 user nova-compute[71308]: node.discovery_port = 0
Apr 14 18:59:29 user nova-compute[71308]: node.discovery_type = static
Apr 14 18:59:29 user nova-compute[71308]: node.session.initial_cmdsn = 0
Apr 14 18:59:29 user nova-compute[71308]: node.session.initial_login_retry_max = 8
Apr 14 18:59:29 user nova-compute[71308]: node.session.xmit_thread_priority = -20
Apr 14 18:59:29 user nova-compute[71308]: node.session.cmds_max = 128
Apr 14 18:59:29 user nova-compute[71308]: node.session.queue_depth = 32
Apr 14 18:59:29 user nova-compute[71308]: node.session.nr_sessions = 1
Apr 14 18:59:29 user nova-compute[71308]: node.session.auth.authmethod = CHAP
Apr 14 18:59:29 user nova-compute[71308]: node.session.auth.username = JyaEeBsX
Apr 14 18:59:29 user nova-compute[71308]: node.session.auth.password = ***
Apr 14 18:59:29 user nova-compute[71308]: node.session.auth.username_in = <empty>
Apr 14 18:59:29 user nova-compute[71308]: node.session.auth.password_in = <empty>
Apr 14 18:59:29 user nova-compute[71308]: node.session.auth.chap_algs = MD5
Apr 14 18:59:29 user nova-compute[71308]: node.session.timeo.replacement_timeout = 120
Apr 14 18:59:29 user nova-compute[71308]: node.session.err_timeo.abort_timeout = 15
Apr 14 18:59:29 user nova-compute[71308]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 18:59:29 user nova-compute[71308]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 18:59:29 user nova-compute[71308]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.FastAbort = Yes
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.InitialR2T = No
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.ImmediateData = Yes
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.MaxConnections = 1
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 18:59:29 user nova-compute[71308]: node.session.iscsi.ERL = 0
Apr 14 18:59:29 user nova-compute[71308]: node.session.scan = manual
Apr 14 18:59:29 user nova-compute[71308]: node.session.reopen_max = 0
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].address = 172.16.0.220
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].port = 3260
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].startup = manual
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].tcp.window_size = 524288
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].tcp.type_of_service = 0
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].timeo.logout_timeout = 15
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].timeo.login_timeout = 15
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].timeo.auth_timeout = 45
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].iscsi.DataDigest = None
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].iscsi.IFMarker = No
Apr 14 18:59:29 user nova-compute[71308]: node.conn[0].iscsi.OFMarker = No
Apr 14 18:59:29 user nova-compute[71308]: # END RECORD
Apr 14 18:59:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b917b1-70a2-42ce-afad-de10866c386f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received event network-vif-unplugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] No waiting events found dispatching network-vif-unplugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-1f047927-69d5-458f-9d72-294e49893b52 req-d4e70e54-1582-408d-9b70-59f0f3d729b3 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received event network-vif-unplugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98dd525-a606-4a15-9650-2d735da407bb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JyaEeBsX {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JyaEeBsX" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7815195b-1a70-4ddc-9c83-69c8087cd51e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JyaEeBsX'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1f49d6-1c87-4970-9656-d0b46fe45e27]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc5f2fe-6ebb-4e54-bf5f-f8a4add8722b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:59:29 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:59:29 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 18:59:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 18:59:29 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 18:59:29 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 18:59:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] HCTL ('34', '0', '0', 0) found on session 36 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d55436-d0e3-4cda-97be-8e11f595dbb7]: (4, ('0 0 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Searching for a device in session 36 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyaEeBsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] <== connect_volume: return (203ms) {'type': 'block', 'scsi_wwn': '23137393336363334', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137393336363334', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1753583208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1753583208',id=30,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-7fe4io26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:57:51Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "vif_mac": "fa:16:3e:bc:fb:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "vif_mac": "fa:16:3e:bc:fb:c2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:fb:c2,bridge_name='br-int',has_traffic_filtering=True,id=3a14f42c-2105-477c-8012-069d489f2d91,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a14f42c-21') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:59:29 user nova-compute[71308]:   <uuid>1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1</uuid>
Apr 14 18:59:29 user nova-compute[71308]:   <name>instance-0000001e</name>
Apr 14 18:59:29 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:59:29 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:59:29 user nova-compute[71308]:   <metadata>
Apr 14 18:59:29 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:59:29 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:59:29 user nova-compute[71308]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1753583208</nova:name>
Apr 14 18:59:29 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:59:29</nova:creationTime>
Apr 14 18:59:29 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:59:29 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:59:29 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:59:29 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:59:29 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:59:29 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:59:29 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:59:29 user nova-compute[71308]:       <nova:owner>
Apr 14 18:59:29 user nova-compute[71308]:         <nova:user uuid="a644b8bb9b90494ba670da8315bfe005">tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member</nova:user>
Apr 14 18:59:29 user nova-compute[71308]:         <nova:project uuid="424e732759884efa8fd126cd9a082c8a">tempest-ServerBootFromVolumeStableRescueTest-1815450365</nova:project>
Apr 14 18:59:29 user nova-compute[71308]:       </nova:owner>
Apr 14 18:59:29 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:59:29 user nova-compute[71308]:       <nova:ports>
Apr 14 18:59:29 user nova-compute[71308]:         <nova:port uuid="3a14f42c-2105-477c-8012-069d489f2d91">
Apr 14 18:59:29 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 18:59:29 user nova-compute[71308]:         </nova:port>
Apr 14 18:59:29 user nova-compute[71308]:       </nova:ports>
Apr 14 18:59:29 user nova-compute[71308]:     </nova:instance>
Apr 14 18:59:29 user nova-compute[71308]:   </metadata>
Apr 14 18:59:29 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:59:29 user nova-compute[71308]:     <system>
Apr 14 18:59:29 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:59:29 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:59:29 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:59:29 user nova-compute[71308]:       <entry name="serial">1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1</entry>
Apr 14 18:59:29 user nova-compute[71308]:       <entry name="uuid">1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1</entry>
Apr 14 18:59:29 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:59:29 user nova-compute[71308]:     </system>
Apr 14 18:59:29 user nova-compute[71308]:   </sysinfo>
Apr 14 18:59:29 user nova-compute[71308]:   <os>
Apr 14 18:59:29 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:59:29 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:59:29 user nova-compute[71308]:   </os>
Apr 14 18:59:29 user nova-compute[71308]:   <features>
Apr 14 18:59:29 user nova-compute[71308]:     <acpi/>
Apr 14 18:59:29 user nova-compute[71308]:     <apic/>
Apr 14 18:59:29 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:59:29 user nova-compute[71308]:   </features>
Apr 14 18:59:29 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:59:29 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:59:29 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:59:29 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:59:29 user nova-compute[71308]:   </clock>
Apr 14 18:59:29 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:59:29 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:59:29 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:59:29 user nova-compute[71308]:   </cpu>
Apr 14 18:59:29 user nova-compute[71308]:   <devices>
Apr 14 18:59:29 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 18:59:29 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 18:59:29 user nova-compute[71308]:       <source dev="/dev/sdc"/>
Apr 14 18:59:29 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:59:29 user nova-compute[71308]:       <serial>30e0fe34-9aba-4c9b-9fa6-18333cbc07b9</serial>
Apr 14 18:59:29 user nova-compute[71308]:     </disk>
Apr 14 18:59:29 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:59:29 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:59:29 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue"/>
Apr 14 18:59:29 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 18:59:29 user nova-compute[71308]:       <boot order="1"/>
Apr 14 18:59:29 user nova-compute[71308]:     </disk>
Apr 14 18:59:29 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:59:29 user nova-compute[71308]:       <mac address="fa:16:3e:bc:fb:c2"/>
Apr 14 18:59:29 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:59:29 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:59:29 user nova-compute[71308]:       <target dev="tap3a14f42c-21"/>
Apr 14 18:59:29 user nova-compute[71308]:     </interface>
Apr 14 18:59:29 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:59:29 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/console.log" append="off"/>
Apr 14 18:59:29 user nova-compute[71308]:     </serial>
Apr 14 18:59:29 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:59:29 user nova-compute[71308]:     <video>
Apr 14 18:59:29 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:59:29 user nova-compute[71308]:     </video>
Apr 14 18:59:29 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:59:29 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:59:29 user nova-compute[71308]:     </rng>
Apr 14 18:59:29 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:59:29 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:59:29 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:59:29 user nova-compute[71308]:     </memballoon>
Apr 14 18:59:29 user nova-compute[71308]:   </devices>
Apr 14 18:59:29 user nova-compute[71308]: </domain>
Apr 14 18:59:29 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:59:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Instance destroyed successfully.
Apr 14 18:59:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Instance destroyed successfully.
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lazy-loading 'resources' on Instance uuid 68af5668-55ba-4150-be95-b6861afc820d {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] No VIF found with MAC fa:16:3e:bc:fb:c2, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2068101705',display_name='tempest-AttachVolumeNegativeTest-server-2068101705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2068101705',id=29,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2Y+X0ylyQAREcSqEFGU5KeK2JvYOxhUWKfD/HUL9LFnlnUPybIFrwN2cT6ZXOqujmMgrSHLf91Rlk8UY3HFa6RIp06SQEfEAyGI2m5HAFjxpzFiEFu0hqSEeY/EcUNmw==',key_name='tempest-keypair-1888884509',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e34cdebcd7154988a957deae140e8eab',ramdisk_id='',reservation_id='r-80iby6n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1648028886',owner_user_name='tempest-AttachVolumeNegativeTest-1648028886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:56:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d53edaffb8f4038abd366d7942c6bc7',uuid=68af5668-55ba-4150-be95-b6861afc820d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converting VIF {"id": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "address": "fa:16:3e:4f:2a:4d", "network": {"id": "ebff2aa0-97cc-48ab-8839-3dff795a5b06", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-170760412-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e34cdebcd7154988a957deae140e8eab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc608b2-22", "ovs_interfaceid": "bdc608b2-229e-4fc9-a251-dbb53cafa70a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:2a:4d,bridge_name='br-int',has_traffic_filtering=True,id=bdc608b2-229e-4fc9-a251-dbb53cafa70a,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc608b2-22') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG os_vif [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:2a:4d,bridge_name='br-int',has_traffic_filtering=True,id=bdc608b2-229e-4fc9-a251-dbb53cafa70a,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc608b2-22') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdc608b2-22, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:29 user nova-compute[71308]: INFO os_vif [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:2a:4d,bridge_name='br-int',has_traffic_filtering=True,id=bdc608b2-229e-4fc9-a251-dbb53cafa70a,network=Network(ebff2aa0-97cc-48ab-8839-3dff795a5b06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc608b2-22')
Apr 14 18:59:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Deleting instance files /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d_del
Apr 14 18:59:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Deletion of /opt/stack/data/nova/instances/68af5668-55ba-4150-be95-b6861afc820d_del complete
Apr 14 18:59:29 user nova-compute[71308]: INFO nova.compute.manager [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 18:59:29 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 18:59:29 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 68af5668-55ba-4150-be95-b6861afc820d] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:59:30 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Took 0.94 seconds to deallocate network for instance.
Apr 14 18:59:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-9ad1cbc5-baa6-495e-835b-244948945ca3 req-1f913a68-a299-49f3-b271-777fe274b3b1 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received event network-vif-deleted-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:59:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:30 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Deleted allocations for instance 68af5668-55ba-4150-be95-b6861afc820d
Apr 14 18:59:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:31 user nova-compute[71308]: WARNING nova.compute.manager [req-5398eed7-53a1-41ac-8c94-b84d34875595 req-755b7060-20c8-46b9-ac7c-6d2cd9608531 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state active and task_state rescuing.
Apr 14 18:59:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35f4ca67-f982-4e4b-92b1-b78fdfff84dd tempest-AttachVolumeNegativeTest-1648028886 tempest-AttachVolumeNegativeTest-1648028886-project-member] Lock "68af5668-55ba-4150-be95-b6861afc820d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.405s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received event network-vif-plugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] Acquiring lock "68af5668-55ba-4150-be95-b6861afc820d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] Lock "68af5668-55ba-4150-be95-b6861afc820d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] No waiting events found dispatching network-vif-plugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:31 user nova-compute[71308]: WARNING nova.compute.manager [req-7bda9428-06ca-406d-95c8-2224c1c4fe9d req-3a2852a7-a156-4b55-b6f9-0e4b015831e6 service nova] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Received unexpected event network-vif-plugged-bdc608b2-229e-4fc9-a251-dbb53cafa70a for instance with vm_state deleted and task_state None.
Apr 14 18:59:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 18:59:32 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498772.9500568, 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:32 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] VM Resumed (Lifecycle Event)
Apr 14 18:59:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-2868ea6f-5ed5-4992-b2b1-0a9da0266bcb tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 18:59:33 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498772.95061, 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:33 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] VM Started (Lifecycle Event)
Apr 14 18:59:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:33 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:33 user nova-compute[71308]: WARNING nova.compute.manager [req-9f62b9b9-7ad9-47ad-9cff-0baccdbe50d5 req-0a403ba2-8c0d-4e92-ad07-6b3540ce5a12 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state rescued and task_state None.
Apr 14 18:59:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:59:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:44 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498769.4356904, 68af5668-55ba-4150-be95-b6861afc820d => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:44 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 68af5668-55ba-4150-be95-b6861afc820d] VM Stopped (Lifecycle Event)
Apr 14 18:59:44 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fc2ee758-e07b-4659-b658-d0a8eae83444 None None] [instance: 68af5668-55ba-4150-be95-b6861afc820d] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "46d51513-1995-43c5-976a-40789ae575f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "46d51513-1995-43c5-976a-40789ae575f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 18:59:52 user nova-compute[71308]: INFO nova.compute.claims [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Claim successful on node user
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.network.neutron [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 18:59:52 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 18:59:52 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Creating image(s)
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "/opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "/opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "/opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG nova.policy [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk 1073741824" returned: 0 in 0.050s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.130s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Cannot resize image /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG nova.objects.instance [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'migration_context' on Instance uuid 46d51513-1995-43c5-976a-40789ae575f1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Ensure instance console log exists: /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Successfully created port: 48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Successfully updated port: 48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received event network-changed-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG nova.compute.manager [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Refreshing instance network info cache due to event network-changed-48f196d4-dd0c-4499-8b7b-b0c4199cc059. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] Acquiring lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 18:59:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.network.neutron [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updating instance_info_cache with network_info: [{"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Instance network_info: |[{"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] Acquired lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.network.neutron [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Refreshing network info cache for port 48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Start _get_guest_xml network_info=[{"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 18:59:55 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:55 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2011359159',display_name='tempest-ServerActionsTestJSON-server-2011359159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2011359159',id=34,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-ap6g1hl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:59:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=46d51513-1995-43c5-976a-40789ae575f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=48f196d4-dd0c-4499-8b7b-b0c4199cc059,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f196d4-dd') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.objects.instance [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'pci_devices' on Instance uuid 46d51513-1995-43c5-976a-40789ae575f1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 18:59:55 user nova-compute[71308]:   <uuid>46d51513-1995-43c5-976a-40789ae575f1</uuid>
Apr 14 18:59:55 user nova-compute[71308]:   <name>instance-00000022</name>
Apr 14 18:59:55 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 18:59:55 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 18:59:55 user nova-compute[71308]:   <metadata>
Apr 14 18:59:55 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 18:59:55 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 18:59:55 user nova-compute[71308]:       <nova:name>tempest-ServerActionsTestJSON-server-2011359159</nova:name>
Apr 14 18:59:55 user nova-compute[71308]:       <nova:creationTime>2023-04-14 18:59:55</nova:creationTime>
Apr 14 18:59:55 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 18:59:55 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 18:59:55 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 18:59:55 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 18:59:55 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 18:59:55 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 18:59:55 user nova-compute[71308]:       </nova:flavor>
Apr 14 18:59:55 user nova-compute[71308]:       <nova:owner>
Apr 14 18:59:55 user nova-compute[71308]:         <nova:user uuid="55fa4abe2fdd48cb91f39bf8156a7793">tempest-ServerActionsTestJSON-2112054326-project-member</nova:user>
Apr 14 18:59:55 user nova-compute[71308]:         <nova:project uuid="f028a79640b848228dc6e654a0eef49b">tempest-ServerActionsTestJSON-2112054326</nova:project>
Apr 14 18:59:55 user nova-compute[71308]:       </nova:owner>
Apr 14 18:59:55 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 18:59:55 user nova-compute[71308]:       <nova:ports>
Apr 14 18:59:55 user nova-compute[71308]:         <nova:port uuid="48f196d4-dd0c-4499-8b7b-b0c4199cc059">
Apr 14 18:59:55 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 18:59:55 user nova-compute[71308]:         </nova:port>
Apr 14 18:59:55 user nova-compute[71308]:       </nova:ports>
Apr 14 18:59:55 user nova-compute[71308]:     </nova:instance>
Apr 14 18:59:55 user nova-compute[71308]:   </metadata>
Apr 14 18:59:55 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 18:59:55 user nova-compute[71308]:     <system>
Apr 14 18:59:55 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 18:59:55 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 18:59:55 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 18:59:55 user nova-compute[71308]:       <entry name="serial">46d51513-1995-43c5-976a-40789ae575f1</entry>
Apr 14 18:59:55 user nova-compute[71308]:       <entry name="uuid">46d51513-1995-43c5-976a-40789ae575f1</entry>
Apr 14 18:59:55 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 18:59:55 user nova-compute[71308]:     </system>
Apr 14 18:59:55 user nova-compute[71308]:   </sysinfo>
Apr 14 18:59:55 user nova-compute[71308]:   <os>
Apr 14 18:59:55 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 18:59:55 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 18:59:55 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 18:59:55 user nova-compute[71308]:   </os>
Apr 14 18:59:55 user nova-compute[71308]:   <features>
Apr 14 18:59:55 user nova-compute[71308]:     <acpi/>
Apr 14 18:59:55 user nova-compute[71308]:     <apic/>
Apr 14 18:59:55 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 18:59:55 user nova-compute[71308]:   </features>
Apr 14 18:59:55 user nova-compute[71308]:   <clock offset="utc">
Apr 14 18:59:55 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 18:59:55 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 18:59:55 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 18:59:55 user nova-compute[71308]:   </clock>
Apr 14 18:59:55 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 18:59:55 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 18:59:55 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 18:59:55 user nova-compute[71308]:   </cpu>
Apr 14 18:59:55 user nova-compute[71308]:   <devices>
Apr 14 18:59:55 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 18:59:55 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 18:59:55 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk"/>
Apr 14 18:59:55 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 18:59:55 user nova-compute[71308]:     </disk>
Apr 14 18:59:55 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 18:59:55 user nova-compute[71308]:       <mac address="fa:16:3e:b3:87:0a"/>
Apr 14 18:59:55 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:59:55 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 18:59:55 user nova-compute[71308]:       <target dev="tap48f196d4-dd"/>
Apr 14 18:59:55 user nova-compute[71308]:     </interface>
Apr 14 18:59:55 user nova-compute[71308]:     <serial type="pty">
Apr 14 18:59:55 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/console.log" append="off"/>
Apr 14 18:59:55 user nova-compute[71308]:     </serial>
Apr 14 18:59:55 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 18:59:55 user nova-compute[71308]:     <video>
Apr 14 18:59:55 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 18:59:55 user nova-compute[71308]:     </video>
Apr 14 18:59:55 user nova-compute[71308]:     <rng model="virtio">
Apr 14 18:59:55 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 18:59:55 user nova-compute[71308]:     </rng>
Apr 14 18:59:55 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 18:59:55 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 18:59:55 user nova-compute[71308]:       <stats period="10"/>
Apr 14 18:59:55 user nova-compute[71308]:     </memballoon>
Apr 14 18:59:55 user nova-compute[71308]:   </devices>
Apr 14 18:59:55 user nova-compute[71308]: </domain>
Apr 14 18:59:55 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2011359159',display_name='tempest-ServerActionsTestJSON-server-2011359159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2011359159',id=34,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-ap6g1hl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:59:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=46d51513-1995-43c5-976a-40789ae575f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=48f196d4-dd0c-4499-8b7b-b0c4199cc059,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f196d4-dd') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG os_vif [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=48f196d4-dd0c-4499-8b7b-b0c4199cc059,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f196d4-dd') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48f196d4-dd, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap48f196d4-dd, col_values=(('external_ids', {'iface-id': '48f196d4-dd0c-4499-8b7b-b0c4199cc059', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:87:0a', 'vm-uuid': '46d51513-1995-43c5-976a-40789ae575f1'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:55 user nova-compute[71308]: INFO os_vif [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=48f196d4-dd0c-4499-8b7b-b0c4199cc059,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f196d4-dd')
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No VIF found with MAC fa:16:3e:b3:87:0a, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.network.neutron [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updated VIF entry in instance network info cache for port 48f196d4-dd0c-4499-8b7b-b0c4199cc059. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG nova.network.neutron [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updating instance_info_cache with network_info: [{"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 18:59:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b6a5278d-a89d-4462-9717-7df94ac0be19 req-b26665ab-11c9-4549-a51e-c80bbe8e72a5 service nova] Releasing lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 18:59:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:56 user nova-compute[71308]: DEBUG nova.compute.manager [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received event network-vif-plugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] Acquiring lock "46d51513-1995-43c5-976a-40789ae575f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:56 user nova-compute[71308]: DEBUG nova.compute.manager [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] No waiting events found dispatching network-vif-plugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:56 user nova-compute[71308]: WARNING nova.compute.manager [req-246d8317-1fef-4b98-a553-b91b0418e722 req-1baffc63-3861-43d3-9c55-2010373f64ed service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received unexpected event network-vif-plugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance with vm_state building and task_state spawning.
Apr 14 18:59:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498798.8484082, 46d51513-1995-43c5-976a-40789ae575f1 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:58 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] VM Resumed (Lifecycle Event)
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 18:59:58 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Instance spawned successfully.
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 18:59:58 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498798.852918, 46d51513-1995-43c5-976a-40789ae575f1 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 18:59:58 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] VM Started (Lifecycle Event)
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 18:59:58 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 18:59:58 user nova-compute[71308]: INFO nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Took 6.28 seconds to spawn the instance on the hypervisor.
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received event network-vif-plugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] Acquiring lock "46d51513-1995-43c5-976a-40789ae575f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 18:59:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] No waiting events found dispatching network-vif-plugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 18:59:58 user nova-compute[71308]: WARNING nova.compute.manager [req-be77f378-76e0-438f-bec4-f37bb54a80be req-f9c1f2a1-7736-4c4c-818c-a9ce5f2714a5 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received unexpected event network-vif-plugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance with vm_state building and task_state spawning.
Apr 14 18:59:59 user nova-compute[71308]: INFO nova.compute.manager [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Took 7.05 seconds to build instance.
Apr 14 18:59:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-350ca91d-ddd1-4443-8718-f24bd17337d6 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "46d51513-1995-43c5-976a-40789ae575f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.141s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:08 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:08 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:10 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:00:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7332MB free_disk=26.061058044433594GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 56097076-1e63-41ba-8331-be8ede06c537 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 05891511-e84c-4fe3-a688-edcc27849d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 46d51513-1995-43c5-976a-40789ae575f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:00:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:16 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:00:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-97aafe40-5587-41cf-ba75-6077d9daa7eb" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:00:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-97aafe40-5587-41cf-ba75-6077d9daa7eb" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:00:16 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:00:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Updating instance_info_cache with network_info: [{"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:00:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-97aafe40-5587-41cf-ba75-6077d9daa7eb" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:00:17 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:00:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:00:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received event network-changed-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:00:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Refreshing instance network info cache due to event network-changed-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:00:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] Acquiring lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:00:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] Acquired lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:00:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Refreshing network info cache for port 9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:00:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:24 user nova-compute[71308]: DEBUG nova.objects.instance [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'flavor' on Instance uuid 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:00:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:25 user nova-compute[71308]: INFO nova.compute.manager [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Attaching volume 05d753af-2264-480f-922d-67abff014dfd to /dev/vdb
Apr 14 19:00:25 user nova-compute[71308]: DEBUG os_brick.utils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1461b0e-9e18-40bc-b431-359c4551703d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08e9bf4-b977-48b6-bdd7-d83ce6bcc3d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5997407-57dc-4af2-adcb-e85fd8eb78c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4961bb30-c4d1-4ca0-9d11-a92a5d6658c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG nova.network.neutron [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Updated VIF entry in instance network info cache for port 9c30d673-dfd0-4bd2-ab60-3429b5cd3f92. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG nova.network.neutron [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Updating instance_info_cache with network_info: [{"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:00:25 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30419b7-3408-462e-9151-137eea6368ed]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG os_brick.utils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Updating existing volume attachment record: 76d0686f-a9ad-45f3-95f1-d7c439b52c64 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6e90cd87-bc4e-4bdb-9701-eab78fdb7d42 req-32a7d113-35ff-41bf-9320-3c7e106a5e68 service nova] Releasing lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:00:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:00:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYqQJrCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:00:29 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:00:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:00:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:00:29 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:00:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:00:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:00:29 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:00:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6e4d82-bf3d-462a-85cd-0c42051a2e68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:00:30 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aa18c5-c75b-4b11-a7e4-41604a3cb9a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd] added
Apr 14 19:00:30 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a984562-e8ad-4d10-8937-abc8ba63197c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d3b4b5-4a4c-4608-91d9-426052217d8c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYqQJrCT {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYqQJrCT" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[82433ed6-5687-4b10-9f97-71e901cf3619]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYqQJrCT'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fff873a-23df-457b-89b8-9269a692aee0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b43890-bacd-4882-ade0-59362d139589]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:30 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:30 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd75889-adb5-4c8a-b95f-36f128ce4e12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd, portal: 172.16.0.220,3260]
Apr 14 19:00:30 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd, portal: 172.16.0.220,3260] successful.
Apr 14 19:00:30 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d22f42-2df3-479f-bd52-60a8104ab27c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aec0b9b-7e3f-433e-87ca-127effd38a6b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd (non-flash)
Apr 14 19:00:30 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:30 user nova-compute[71308]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd (non-flash)
Apr 14 19:00:30 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e6e219-5741-4d15-bd0a-417675b99faa]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:00:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYqQJrCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26536633037333734', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536633037333734', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG nova.objects.instance [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'flavor' on Instance uuid 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 19:00:31 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:00:31 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 19:00:31 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:00:31 user nova-compute[71308]:   <serial>05d753af-2264-480f-922d-67abff014dfd</serial>
Apr 14 19:00:31 user nova-compute[71308]: </disk>
Apr 14 19:00:31 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] No VIF found with MAC fa:16:3e:58:b4:9a, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:00:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9e1a0f02-4076-4340-bef0-a07bc2db16fd tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.871s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:33 user nova-compute[71308]: INFO nova.compute.manager [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Detaching volume 05d753af-2264-480f-922d-67abff014dfd
Apr 14 19:00:33 user nova-compute[71308]: INFO nova.virt.block_device [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Attempting to driver detach volume 05d753af-2264-480f-922d-67abff014dfd from mountpoint /dev/vdb
Apr 14 19:00:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Attempting to detach device vdb from instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:00:33 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:00:33 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 19:00:33 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:00:33 user nova-compute[71308]:   <serial>05d753af-2264-480f-922d-67abff014dfd</serial>
Apr 14 19:00:33 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:00:33 user nova-compute[71308]: </disk>
Apr 14 19:00:33 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:00:33 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Successfully detached device vdb from instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 from the persistent domain config.
Apr 14 19:00:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:00:33 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:00:33 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 19:00:33 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:00:33 user nova-compute[71308]:   <serial>05d753af-2264-480f-922d-67abff014dfd</serial>
Apr 14 19:00:33 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:00:33 user nova-compute[71308]: </disk>
Apr 14 19:00:33 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681498833.7033648, 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 19:00:33 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Successfully detached device vdb from instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 from the live domain config.
Apr 14 19:00:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYqQJrCT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:00:33 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[78438ee6-dc03-48d2-b71a-4502f1165a78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:00:33 user nova-compute[71308]: No targets found.
Apr 14 19:00:33 user nova-compute[71308]: iSNS:
Apr 14 19:00:33 user nova-compute[71308]: No targets found.
Apr 14 19:00:33 user nova-compute[71308]: STATIC:
Apr 14 19:00:33 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d
Apr 14 19:00:33 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:00:33 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:00:33 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd
Apr 14 19:00:33 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:00:33 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:00:33 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9
Apr 14 19:00:33 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:00:33 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:00:33 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 19:00:33 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:00:33 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:00:33 user nova-compute[71308]: FIRMWARE:
Apr 14 19:00:33 user nova-compute[71308]: No targets found.
Apr 14 19:00:33 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:00:33 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:00:33 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[15499d10-b693-460e-815f-ce7acbfcd9fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a2541e-9a93-4e10-9efa-3dc5bcb39e2f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:33 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:33 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:33 user nova-compute[71308]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd (non-flash)
Apr 14 19:00:33 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:33 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:33 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:33 user nova-compute[71308]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd (non-flash)
Apr 14 19:00:33 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aaa79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0252127-1892-4a14-a607-70244d196e70]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[81760a72-af9a-479d-b9d4-fbd67bc42f6d]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7eeb38-5633-444d-8523-1fdfd802f3ee]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d4aade-4159-4f3c-9840-2f84ef5d2056]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d30fb82-a418-4e77-b3a2-9a6bb2b4e8d8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:33 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0c8c7a-2407-4afd-9302-4f33406e71e8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd, portal: 172.16.0.220,3260]
Apr 14 19:00:34 user nova-compute[71308]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd, portal: 172.16.0.220,3260] successful.
Apr 14 19:00:34 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05d753af-2264-480f-922d-67abff014dfd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3e3bd-be5e-4b85-bad0-8dbb5108f9ad]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] <== disconnect_volume: return (318ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'flavor' on Instance uuid 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:00:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2254869e-5d88-42ca-a977-b22a1a27c761 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.841s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:00:44 user nova-compute[71308]: INFO nova.compute.claims [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Claim successful on node user
Apr 14 19:00:44 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:00:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:00:44 user nova-compute[71308]: DEBUG nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG nova.network.neutron [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:00:44 user nova-compute[71308]: DEBUG nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:00:44 user nova-compute[71308]: INFO nova.virt.block_device [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Booting with volume snapshot 01b3cb6e-8440-4e21-a3f8-3099c6f0e545 at /dev/vda
Apr 14 19:00:44 user nova-compute[71308]: DEBUG nova.policy [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:00:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:45 user nova-compute[71308]: DEBUG nova.network.neutron [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Successfully created port: dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Successfully updated port: dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "refresh_cache-698bc2dc-aff4-4148-b80e-8b77c846faf7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquired lock "refresh_cache-698bc2dc-aff4-4148-b80e-8b77c846faf7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-changed-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Refreshing instance network info cache due to event network-changed-dc45a89d-f20f-49e4-a526-0355bb98b37f. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] Acquiring lock "refresh_cache-698bc2dc-aff4-4148-b80e-8b77c846faf7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Updating instance_info_cache with network_info: [{"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Releasing lock "refresh_cache-698bc2dc-aff4-4148-b80e-8b77c846faf7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Instance network_info: |[{"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] Acquired lock "refresh_cache-698bc2dc-aff4-4148-b80e-8b77c846faf7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:00:46 user nova-compute[71308]: DEBUG nova.network.neutron [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Refreshing network info cache for port dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:00:47 user nova-compute[71308]: DEBUG nova.network.neutron [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Updated VIF entry in instance network info cache for port dc45a89d-f20f-49e4-a526-0355bb98b37f. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:00:47 user nova-compute[71308]: DEBUG nova.network.neutron [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Updating instance_info_cache with network_info: [{"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:00:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5f2c8813-4e0d-4d75-9beb-b0590c6bc45f req-79906ad2-e62d-4ce0-b332-6b818c6f626a service nova] Releasing lock "refresh_cache-698bc2dc-aff4-4148-b80e-8b77c846faf7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:00:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-changed-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Refreshing instance network info cache due to event network-changed-dff6b65b-1de5-4cb6-b5dd-778d05760cbd. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] Acquiring lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] Acquired lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG nova.network.neutron [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Refreshing network info cache for port dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG nova.objects.instance [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'flavor' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:49 user nova-compute[71308]: INFO nova.compute.manager [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Attaching volume 61176d19-dc87-4e57-9b3c-6ba547a237eb to /dev/vdb
Apr 14 19:00:49 user nova-compute[71308]: DEBUG os_brick.utils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9c9dab-a19a-406a-ab69-c7464de8e499]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d92cc39-3b3b-4059-bca6-14adf50cbcdb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f3d7fb-bc0d-434d-8ab7-6e142334aa60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfe98e7-6308-48d1-8ce4-4bb03bfb41e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:00:49 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a95302-e5b7-40d4-8835-d3303f7af3a9]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG os_brick.utils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating existing volume attachment record: 2bbc684c-94b4-4537-a66e-44d52b31596d {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG nova.network.neutron [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updated VIF entry in instance network info cache for port dff6b65b-1de5-4cb6-b5dd-778d05760cbd. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG nova.network.neutron [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating instance_info_cache with network_info: [{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:00:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e1e56a7b-c15f-4aca-87d5-82e42254cb05 req-1912a328-dd32-4984-a64e-b12eb5764557 service nova] Releasing lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG os_brick.utils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a898fd-7255-4403-812d-0d26f22b509e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d9094-f24e-4d73-8b1b-b98b6e9ab2a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d7cb03-13bc-487b-8d67-bd531713735d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a329f4f1-8188-4cfd-b14f-a0f8bb8c3613]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:00:50 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:00:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b02c53-170d-43ed-b22d-ee78a040c93a]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG os_brick.utils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:00:50 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Updating existing volume attachment record: 7352f5cf-0172-465d-8763-5896cdcc83bf {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:00:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:00:55 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Creating image(s)
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Ensure instance console log exists: /opt/stack/data/nova/instances/698bc2dc-aff4-4148-b80e-8b77c846faf7/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Start _get_guest_xml network_info=[{"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T19:00:40Z,direct_url=<?>,disk_format='qcow2',id=ff35c27c-c625-4fb5-b0ea-54a8464c1258,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1296217083',owner='72d2bf68325a4a18934a8403571c24bb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T19:00:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '7352f5cf-0172-465d-8763-5896cdcc83bf', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMPSGHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '698bc2dc-aff4-4148-b80e-8b77c846faf7', 'attached_at': '', 'detached_at': '', 'volume_id': '6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa', 'serial': '6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:00:55 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:00:55 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T19:00:40Z,direct_url=<?>,disk_format='qcow2',id=ff35c27c-c625-4fb5-b0ea-54a8464c1258,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1296217083',owner='72d2bf68325a4a18934a8403571c24bb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T19:00:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMPSGHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:00:55 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:00:55 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:00:55 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cadf7e-ad13-42fb-b27c-1ec3ac31982f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:00:55 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe255d0-a87d-4581-afc4-31fe302168ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa] added
Apr 14 19:00:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6432ea6b-2cfa-4ad9-8107-f8c2a48b5462]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce3bd20-1ead-4ae0-be27-059b1e2515d6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMPSGHEk {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMPSGHEk" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a501b79-3103-4ea6-a63e-781f0c50b652]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lMPSGHEk'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ccb0e-1d33-4d7d-bc48-58d9d888db58]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66961dd-7578-4d88-b5f1-a104d0f56afc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47265f9-7910-4353-9f86-5c46896bd599]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa, portal: 172.16.0.220,3260]
Apr 14 19:00:55 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa, portal: 172.16.0.220,3260] successful.
Apr 14 19:00:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[63556f19-1bb6-4ce1-9361-b238a48d4799]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDjshJXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:00:55 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6a81b4-df5c-4f95-a808-04cba0ab19c5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:00:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:55 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:00:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2058721b-1762-487f-a22d-2bf281bac859]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:00:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMPSGHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23236323338313665', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236323338313665', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.043s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:00:56 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:00:56 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce436608-d28e-4495-8dbe-f393fc4f979e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:00:56 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-263545530',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-263545530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-263545530',id=35,image_ref='ff35c27c-c625-4fb5-b0ea-54a8464c1258',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-d1dz9x9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1560263906',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:00:45Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=698bc2dc-aff4-4148-b80e-8b77c846faf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:90:4f,bridge_name='br-int',has_traffic_filtering=True,id=dc45a89d-f20f-49e4-a526-0355bb98b37f,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc45a89d-f2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.objects.instance [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'pci_devices' on Instance uuid 698bc2dc-aff4-4148-b80e-8b77c846faf7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[377b3bb7-fcc2-4741-b095-cd9d75211a46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb] added
Apr 14 19:00:56 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:00:56 user nova-compute[71308]:   <uuid>698bc2dc-aff4-4148-b80e-8b77c846faf7</uuid>
Apr 14 19:00:56 user nova-compute[71308]:   <name>instance-00000023</name>
Apr 14 19:00:56 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:00:56 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:00:56 user nova-compute[71308]:   <metadata>
Apr 14 19:00:56 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:00:56 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:00:56 user nova-compute[71308]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-263545530</nova:name>
Apr 14 19:00:56 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:00:55</nova:creationTime>
Apr 14 19:00:56 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:00:56 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:00:56 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:00:56 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:00:56 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:00:56 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:00:56 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:00:56 user nova-compute[71308]:       <nova:owner>
Apr 14 19:00:56 user nova-compute[71308]:         <nova:user uuid="fc3bed70703a49c8bdec2f50193c7f70">tempest-TestVolumeBootPattern-1560263906-project-member</nova:user>
Apr 14 19:00:56 user nova-compute[71308]:         <nova:project uuid="72d2bf68325a4a18934a8403571c24bb">tempest-TestVolumeBootPattern-1560263906</nova:project>
Apr 14 19:00:56 user nova-compute[71308]:       </nova:owner>
Apr 14 19:00:56 user nova-compute[71308]:       <nova:root type="image" uuid="ff35c27c-c625-4fb5-b0ea-54a8464c1258"/>
Apr 14 19:00:56 user nova-compute[71308]:       <nova:ports>
Apr 14 19:00:56 user nova-compute[71308]:         <nova:port uuid="dc45a89d-f20f-49e4-a526-0355bb98b37f">
Apr 14 19:00:56 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 19:00:56 user nova-compute[71308]:         </nova:port>
Apr 14 19:00:56 user nova-compute[71308]:       </nova:ports>
Apr 14 19:00:56 user nova-compute[71308]:     </nova:instance>
Apr 14 19:00:56 user nova-compute[71308]:   </metadata>
Apr 14 19:00:56 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:00:56 user nova-compute[71308]:     <system>
Apr 14 19:00:56 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:00:56 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:00:56 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:00:56 user nova-compute[71308]:       <entry name="serial">698bc2dc-aff4-4148-b80e-8b77c846faf7</entry>
Apr 14 19:00:56 user nova-compute[71308]:       <entry name="uuid">698bc2dc-aff4-4148-b80e-8b77c846faf7</entry>
Apr 14 19:00:56 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:00:56 user nova-compute[71308]:     </system>
Apr 14 19:00:56 user nova-compute[71308]:   </sysinfo>
Apr 14 19:00:56 user nova-compute[71308]:   <os>
Apr 14 19:00:56 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:00:56 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:00:56 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:00:56 user nova-compute[71308]:   </os>
Apr 14 19:00:56 user nova-compute[71308]:   <features>
Apr 14 19:00:56 user nova-compute[71308]:     <acpi/>
Apr 14 19:00:56 user nova-compute[71308]:     <apic/>
Apr 14 19:00:56 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:00:56 user nova-compute[71308]:   </features>
Apr 14 19:00:56 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:00:56 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:00:56 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:00:56 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:00:56 user nova-compute[71308]:   </clock>
Apr 14 19:00:56 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:00:56 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:00:56 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:00:56 user nova-compute[71308]:   </cpu>
Apr 14 19:00:56 user nova-compute[71308]:   <devices>
Apr 14 19:00:56 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 19:00:56 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:00:56 user nova-compute[71308]:       <source dev="/dev/sdb"/>
Apr 14 19:00:56 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:00:56 user nova-compute[71308]:       <serial>6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa</serial>
Apr 14 19:00:56 user nova-compute[71308]:     </disk>
Apr 14 19:00:56 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:00:56 user nova-compute[71308]:       <mac address="fa:16:3e:03:90:4f"/>
Apr 14 19:00:56 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:00:56 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:00:56 user nova-compute[71308]:       <target dev="tapdc45a89d-f2"/>
Apr 14 19:00:56 user nova-compute[71308]:     </interface>
Apr 14 19:00:56 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:00:56 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/698bc2dc-aff4-4148-b80e-8b77c846faf7/console.log" append="off"/>
Apr 14 19:00:56 user nova-compute[71308]:     </serial>
Apr 14 19:00:56 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:00:56 user nova-compute[71308]:     <video>
Apr 14 19:00:56 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:00:56 user nova-compute[71308]:     </video>
Apr 14 19:00:56 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:00:56 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:00:56 user nova-compute[71308]:     </rng>
Apr 14 19:00:56 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:00:56 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:00:56 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:00:56 user nova-compute[71308]:     </memballoon>
Apr 14 19:00:56 user nova-compute[71308]:   </devices>
Apr 14 19:00:56 user nova-compute[71308]: </domain>
Apr 14 19:00:56 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-263545530',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-263545530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-263545530',id=35,image_ref='ff35c27c-c625-4fb5-b0ea-54a8464c1258',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-d1dz9x9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1560263906',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:00:45Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=698bc2dc-aff4-4148-b80e-8b77c846faf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:90:4f,bridge_name='br-int',has_traffic_filtering=True,id=dc45a89d-f20f-49e4-a526-0355bb98b37f,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc45a89d-f2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_vif [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:90:4f,bridge_name='br-int',has_traffic_filtering=True,id=dc45a89d-f20f-49e4-a526-0355bb98b37f,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc45a89d-f2') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de3b54b-f0b0-48c2-a20d-fff50248b492]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc45a89d-f2, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc45a89d-f2, col_values=(('external_ids', {'iface-id': 'dc45a89d-f20f-49e4-a526-0355bb98b37f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:90:4f', 'vm-uuid': '698bc2dc-aff4-4148-b80e-8b77c846faf7'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:56 user nova-compute[71308]: INFO os_vif [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:90:4f,bridge_name='br-int',has_traffic_filtering=True,id=dc45a89d-f20f-49e4-a526-0355bb98b37f,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc45a89d-f2')
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42563af-7fd5-418b-ba51-cd35fc6b342f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDjshJXT {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lDjshJXT" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb615245-028e-4879-aecd-dddc565afcfa]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lDjshJXT'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No VIF found with MAC fa:16:3e:03:90:4f, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5ebb94-5f89-4260-96c0-cded8221f771]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[50766833-3abf-4357-be15-eadd8a36ce39]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:56 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:56 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:56 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:00:56 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:56 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:56 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:56 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:00:56 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:00:56 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a9f96-acb2-4d17-9ae2-7ed565a9c8a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb, portal: 172.16.0.220,3260]
Apr 14 19:00:57 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb, portal: 172.16.0.220,3260] successful.
Apr 14 19:00:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a85016-331b-479a-913f-008bad7f0b89]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[49528e32-2121-4229-97e0-ae9f868130c9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:57 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:57 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:57 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:00:57 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:00:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:00:57 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:00:57 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:00:57 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:00:57 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:00:57 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f4aeda-0af5-46a1-bcff-ba040cd2f1f2]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:00:57 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDjshJXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] <== connect_volume: return (2455ms) {'type': 'block', 'scsi_wwn': '26363376165636165', 'path': '/dev/sdf'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363376165636165', 'path': '/dev/sdf'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG nova.objects.instance [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'flavor' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 19:00:58 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:00:58 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 19:00:58 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:00:58 user nova-compute[71308]:   <serial>61176d19-dc87-4e57-9b3c-6ba547a237eb</serial>
Apr 14 19:00:58 user nova-compute[71308]: </disk>
Apr 14 19:00:58 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] No waiting events found dispatching network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:00:58 user nova-compute[71308]: WARNING nova.compute.manager [req-9da44f83-0fe6-47bb-99f6-1d43c2704182 req-73a956a0-4d20-44c1-8ea8-b686530c757a service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received unexpected event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f for instance with vm_state building and task_state spawning.
Apr 14 19:00:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No VIF found with MAC fa:16:3e:27:4f:50, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:00:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a5513497-a699-441f-8eb2-13087668d348 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.414s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:00:59 user nova-compute[71308]: INFO nova.compute.manager [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Rescuing
Apr 14 19:00:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:00:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquired lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:00:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:00:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating instance_info_cache with network_info: [{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Releasing lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-unplugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-unplugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:00 user nova-compute[71308]: WARNING nova.compute.manager [req-4fff539a-939a-4cd3-bc51-088ba912b2db req-05023108-86f8-4a04-a64d-688c5d895990 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-unplugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state active and task_state rescuing.
Apr 14 19:01:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] No waiting events found dispatching network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:00 user nova-compute[71308]: WARNING nova.compute.manager [req-ee29ab56-b5cc-464b-a305-dfd26f048cc8 req-0ba8f7d6-2201-442f-9d51-9b16abb2b522 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received unexpected event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f for instance with vm_state building and task_state spawning.
Apr 14 19:01:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Instance destroyed successfully.
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Attempting rescue
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71308) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Instance directory exists: not creating {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Creating image(s)
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'trusted_certs' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498861.1493566, 698bc2dc-aff4-4148-b80e-8b77c846faf7 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] VM Resumed (Lifecycle Event)
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Instance spawned successfully.
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.174s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498861.1501026, 698bc2dc-aff4-4148-b80e-8b77c846faf7 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] VM Started (Lifecycle Event)
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue" returned: 0 in 0.085s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'migration_context' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Start _get_guest_xml network_info=[{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "vif_mac": "fa:16:3e:27:4f:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'resources' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'numa_topology' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.compute.manager [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Took 17.23 seconds to build instance.
Apr 14 19:01:01 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:01:01 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-670b4e15-c376-4b6d-9017-848c0e75510b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.350s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.compute.manager [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Terminating instance
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-878359626',display_name='tempest-ServerRescueNegativeTestJSON-server-878359626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-878359626',id=33,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsV7S4Lu7EScb7Ca1HXXWHMkfNibGLUsHaVxGGFEiPOu+DZdxz7O+eYdDkk0eqIIMAOS8zIzZ1Dx0oJrzQLMfBVS8ZQb5vqX9QOfeUkQuI1qS8pmjCXzIvfDogAaOvDEA==',key_name='tempest-keypair-126127202',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-6n0xph1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T18:59:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=05891511-e84c-4fe3-a688-edcc27849d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "vif_mac": "fa:16:3e:27:4f:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "vif_mac": "fa:16:3e:27:4f:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:4f:50,bridge_name='br-int',has_traffic_filtering=True,id=dff6b65b-1de5-4cb6-b5dd-778d05760cbd,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff6b65b-1d') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'pci_devices' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:01:01 user nova-compute[71308]:   <uuid>05891511-e84c-4fe3-a688-edcc27849d58</uuid>
Apr 14 19:01:01 user nova-compute[71308]:   <name>instance-00000021</name>
Apr 14 19:01:01 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:01:01 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:01:01 user nova-compute[71308]:   <metadata>
Apr 14 19:01:01 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:01:01 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:01:01 user nova-compute[71308]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-878359626</nova:name>
Apr 14 19:01:01 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:01:01</nova:creationTime>
Apr 14 19:01:01 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:01:01 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:01:01 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:01:01 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:01:01 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:01:01 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:01:01 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:01:01 user nova-compute[71308]:       <nova:owner>
Apr 14 19:01:01 user nova-compute[71308]:         <nova:user uuid="c8713ed85ffb4446847f5ded4bc2e399">tempest-ServerRescueNegativeTestJSON-1174646715-project-member</nova:user>
Apr 14 19:01:01 user nova-compute[71308]:         <nova:project uuid="e60e8abd123e414f847c68ba72894689">tempest-ServerRescueNegativeTestJSON-1174646715</nova:project>
Apr 14 19:01:01 user nova-compute[71308]:       </nova:owner>
Apr 14 19:01:01 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 19:01:01 user nova-compute[71308]:       <nova:ports>
Apr 14 19:01:01 user nova-compute[71308]:         <nova:port uuid="dff6b65b-1de5-4cb6-b5dd-778d05760cbd">
Apr 14 19:01:01 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 19:01:01 user nova-compute[71308]:         </nova:port>
Apr 14 19:01:01 user nova-compute[71308]:       </nova:ports>
Apr 14 19:01:01 user nova-compute[71308]:     </nova:instance>
Apr 14 19:01:01 user nova-compute[71308]:   </metadata>
Apr 14 19:01:01 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:01:01 user nova-compute[71308]:     <system>
Apr 14 19:01:01 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:01:01 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:01:01 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:01:01 user nova-compute[71308]:       <entry name="serial">05891511-e84c-4fe3-a688-edcc27849d58</entry>
Apr 14 19:01:01 user nova-compute[71308]:       <entry name="uuid">05891511-e84c-4fe3-a688-edcc27849d58</entry>
Apr 14 19:01:01 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:01:01 user nova-compute[71308]:     </system>
Apr 14 19:01:01 user nova-compute[71308]:   </sysinfo>
Apr 14 19:01:01 user nova-compute[71308]:   <os>
Apr 14 19:01:01 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:01:01 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:01:01 user nova-compute[71308]:   </os>
Apr 14 19:01:01 user nova-compute[71308]:   <features>
Apr 14 19:01:01 user nova-compute[71308]:     <acpi/>
Apr 14 19:01:01 user nova-compute[71308]:     <apic/>
Apr 14 19:01:01 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:01:01 user nova-compute[71308]:   </features>
Apr 14 19:01:01 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:01:01 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:01:01 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:01:01 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:01:01 user nova-compute[71308]:   </clock>
Apr 14 19:01:01 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:01:01 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:01:01 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:01:01 user nova-compute[71308]:   </cpu>
Apr 14 19:01:01 user nova-compute[71308]:   <devices>
Apr 14 19:01:01 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:01:01 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:01:01 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue"/>
Apr 14 19:01:01 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:01:01 user nova-compute[71308]:     </disk>
Apr 14 19:01:01 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:01:01 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:01:01 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk"/>
Apr 14 19:01:01 user nova-compute[71308]:       <target dev="vdb" bus="virtio"/>
Apr 14 19:01:01 user nova-compute[71308]:     </disk>
Apr 14 19:01:01 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:01:01 user nova-compute[71308]:       <mac address="fa:16:3e:27:4f:50"/>
Apr 14 19:01:01 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:01:01 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:01:01 user nova-compute[71308]:       <target dev="tapdff6b65b-1d"/>
Apr 14 19:01:01 user nova-compute[71308]:     </interface>
Apr 14 19:01:01 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:01:01 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/console.log" append="off"/>
Apr 14 19:01:01 user nova-compute[71308]:     </serial>
Apr 14 19:01:01 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:01:01 user nova-compute[71308]:     <video>
Apr 14 19:01:01 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:01:01 user nova-compute[71308]:     </video>
Apr 14 19:01:01 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:01:01 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:01:01 user nova-compute[71308]:     </rng>
Apr 14 19:01:01 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:01:01 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:01:01 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:01:01 user nova-compute[71308]:     </memballoon>
Apr 14 19:01:01 user nova-compute[71308]:   </devices>
Apr 14 19:01:01 user nova-compute[71308]: </domain>
Apr 14 19:01:01 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:01:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Instance destroyed successfully.
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] No VIF found with MAC fa:16:3e:27:4f:50, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:02 user nova-compute[71308]: WARNING nova.compute.manager [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state active and task_state rescuing.
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:02 user nova-compute[71308]: WARNING nova.compute.manager [req-c2f6e150-dd61-40f7-9a37-0edf885d48dc req-933584d0-a010-4f07-9adc-4f66593c9b30 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state active and task_state deleting.
Apr 14 19:01:02 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Instance destroyed successfully.
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.objects.instance [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'resources' on Instance uuid 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1892211249',display_name='tempest-AttachVolumeTestJSON-server-1892211249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1892211249',id=20,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0U9FIo3XOjF6nYOtpXqE6JTO0lfoK8cuvWzthES49Nzff4NYIWc7KAGEhCpgBFjl3FZ9COcqUY5TUh5gsbwj+aRK/oLJ3yk94GFQmTSLPJ9Vd0arUl5Z9OdqqzV9kjBA==',key_name='tempest-keypair-1957519464',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-h1jd70xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:59:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=0050e6bb-0b53-4fdc-8437-16b94ee79fa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "address": "fa:16:3e:18:06:fd", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd49e6c-3f", "ovs_interfaceid": "2dd49e6c-3f3a-4124-aff8-a4a4e898cf21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG os_vif [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd49e6c-3f, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:02 user nova-compute[71308]: INFO os_vif [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:06:fd,bridge_name='br-int',has_traffic_filtering=True,id=2dd49e6c-3f3a-4124-aff8-a4a4e898cf21,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd49e6c-3f')
Apr 14 19:01:02 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Deleting instance files /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4_del
Apr 14 19:01:02 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Deletion of /opt/stack/data/nova/instances/0050e6bb-0b53-4fdc-8437-16b94ee79fa4_del complete
Apr 14 19:01:02 user nova-compute[71308]: INFO nova.compute.manager [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Took 1.29 seconds to destroy the instance on the hypervisor.
Apr 14 19:01:02 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:01:02 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:04 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Took 1.22 seconds to deallocate network for instance.
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-b31dd5b0-8ae1-4dae-a296-a7542ffeecd9 req-a8266610-b301-4e56-b3b8-c0e4f720952b service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-deleted-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:04 user nova-compute[71308]: WARNING nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state deleted and task_state None.
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:04 user nova-compute[71308]: WARNING nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state deleted and task_state None.
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:04 user nova-compute[71308]: WARNING nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-unplugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state deleted and task_state None.
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Acquiring lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] No waiting events found dispatching network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:04 user nova-compute[71308]: WARNING nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Received unexpected event network-vif-plugged-2dd49e6c-3f3a-4124-aff8-a4a4e898cf21 for instance with vm_state deleted and task_state None.
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:04 user nova-compute[71308]: WARNING nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state active and task_state rescuing.
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:04 user nova-compute[71308]: WARNING nova.compute.manager [req-7637d426-a473-4175-af9d-696dd86c022b req-4aff9e76-7719-423e-bd77-a3faefbee2e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state active and task_state rescuing.
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:04 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Deleted allocations for instance 0050e6bb-0b53-4fdc-8437-16b94ee79fa4
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-dfaa3fe2-a4e9-43d1-9a73-44f0a4d754cd tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "0050e6bb-0b53-4fdc-8437-16b94ee79fa4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.324s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:01:05 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 05891511-e84c-4fe3-a688-edcc27849d58 due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 19:01:05 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498865.746554, 05891511-e84c-4fe3-a688-edcc27849d58 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:01:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] VM Resumed (Lifecycle Event)
Apr 14 19:01:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-2907c782-21e2-4ccd-b6fe-5d75e08936d1 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:01:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 19:01:05 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498865.747926, 05891511-e84c-4fe3-a688-edcc27849d58 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:01:05 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] VM Started (Lifecycle Event)
Apr 14 19:01:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:01:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:01:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:01:09 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:01:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:01:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:01:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:01:15 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7428MB free_disk=26.07335662841797GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 56097076-1e63-41ba-8331-be8ede06c537 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 05891511-e84c-4fe3-a688-edcc27849d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 46d51513-1995-43c5-976a-40789ae575f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:01:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:16 user nova-compute[71308]: INFO nova.compute.manager [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Unrescuing
Apr 14 19:01:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:01:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquired lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:01:16 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Updating instance_info_cache with network_info: [{"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Releasing lock "refresh_cache-1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG nova.objects.instance [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'flavor' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498862.6664653, 0050e6bb-0b53-4fdc-8437-16b94ee79fa4 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:01:17 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] VM Stopped (Lifecycle Event)
Apr 14 19:01:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG nova.compute.manager [None req-72cd9635-ed53-4094-816a-90298d4de264 None None] [instance: 0050e6bb-0b53-4fdc-8437-16b94ee79fa4] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-unplugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-unplugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:17 user nova-compute[71308]: WARNING nova.compute.manager [req-160da8e9-530b-475e-b250-dc443bcc50a2 req-31215ca8-bdcb-4264-ad33-a167cf60743d service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-unplugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state rescued and task_state unrescuing.
Apr 14 19:01:18 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Instance destroyed successfully.
Apr 14 19:01:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:01:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:01:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:01:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 19:01:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:01:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:01:18 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:01:18 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lazy-loading 'info_cache' on Instance uuid 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updating instance_info_cache with network_info: [{"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:19 user nova-compute[71308]: WARNING nova.compute.manager [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state rescued and task_state unrescuing.
Apr 14 19:01:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:19 user nova-compute[71308]: WARNING nova.compute.manager [req-a4e63e2e-ced0-4e9f-b862-9112452dc628 req-737bdaf2-0b39-443a-a0eb-c9781e551bc6 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state rescued and task_state unrescuing.
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498881.6231883, 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:01:21 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] VM Resumed (Lifecycle Event)
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1367b58f-0db5-470f-9cee-a2c7e18d4f76 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:01:21 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498881.6246128, 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:01:21 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] VM Started (Lifecycle Event)
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:21 user nova-compute[71308]: DEBUG nova.compute.manager [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:21 user nova-compute[71308]: WARNING nova.compute.manager [req-effc085f-6ae2-4085-b71b-ff2629cf594f req-4553e83a-9b6f-4d62-b114-ce4172d47f73 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state active and task_state None.
Apr 14 19:01:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received event network-changed-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Refreshing instance network info cache due to event network-changed-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:01:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] Acquiring lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:01:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] Acquired lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:01:23 user nova-compute[71308]: DEBUG nova.network.neutron [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Refreshing network info cache for port 9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:24 user nova-compute[71308]: INFO nova.compute.manager [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Terminating instance
Apr 14 19:01:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Updated VIF entry in instance network info cache for port 9c30d673-dfd0-4bd2-ab60-3429b5cd3f92. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Updating instance_info_cache with network_info: [{"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-74e0c4b8-6a9c-4062-b6de-7c2090cd8552 req-d199f7a3-150a-43b3-b4da-5ceb0904fda5 service nova] Releasing lock "refresh_cache-48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:01:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Instance destroyed successfully.
Apr 14 19:01:24 user nova-compute[71308]: DEBUG nova.objects.instance [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'resources' on Instance uuid 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1760181806',display_name='tempest-TestStampPattern-server-1760181806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1760181806',id=31,image_ref='b06b95d0-3f1e-4cfc-b707-9f58271dcb39',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx8M4QjbAb47cqa0IIK3DFtHC++DW5qjEMCJfo5EDtvaO/cl4OHImq2UJzNJC1zQSEajn+k79i0pWkmV4FFQZ3qK1iN0DjaB8oxSduo8LZXNaMWp9839OvzlCknJnwL1A==',key_name='tempest-TestStampPattern-580300982',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:58:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='921435d84194431c886ec1ed1848d4d6',ramdisk_id='',reservation_id='r-1378ur01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1feb4399-a5dc-43a7-ac78-4d22809e2737',image_min_disk='1',image_min_ram='0',image_owner_id='921435d84194431c886ec1ed1848d4d6',image_owner_project_name='tempest-TestStampPattern-251531447',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-251531447-project-member',image_user_id='9a9414d0c24643fdb162aad828c736bd',owner_project_name='tempest-TestStampPattern-251531447',owner_user_name='tempest-TestStampPattern-251531447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:58:41Z,user_data=None,user_id='9a9414d0c24643fdb162aad828c736bd',uuid=48e2cdcb-9b4a-458b-95d7-47ef29dd6b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converting VIF {"id": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "address": "fa:16:3e:58:b4:9a", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c30d673-df", "ovs_interfaceid": "9c30d673-dfd0-4bd2-ab60-3429b5cd3f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=9c30d673-dfd0-4bd2-ab60-3429b5cd3f92,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30d673-df') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG os_vif [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=9c30d673-dfd0-4bd2-ab60-3429b5cd3f92,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30d673-df') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c30d673-df, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:01:24 user nova-compute[71308]: INFO os_vif [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:b4:9a,bridge_name='br-int',has_traffic_filtering=True,id=9c30d673-dfd0-4bd2-ab60-3429b5cd3f92,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c30d673-df')
Apr 14 19:01:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Deleting instance files /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58_del
Apr 14 19:01:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Deletion of /opt/stack/data/nova/instances/48e2cdcb-9b4a-458b-95d7-47ef29dd6b58_del complete
Apr 14 19:01:25 user nova-compute[71308]: INFO nova.compute.manager [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 19:01:25 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:01:25 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:01:25 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:01:25 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:25 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Took 0.89 seconds to deallocate network for instance.
Apr 14 19:01:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-0c925d9b-532e-4b2a-8f32-06bb522ab114 req-1fa3af39-ca0d-4c1c-bdb9-3d3f4cb151b8 service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received event network-vif-deleted-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received event network-vif-unplugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] No waiting events found dispatching network-vif-unplugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:26 user nova-compute[71308]: WARNING nova.compute.manager [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received unexpected event network-vif-unplugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance with vm_state deleted and task_state None.
Apr 14 19:01:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received event network-vif-plugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Acquiring lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] No waiting events found dispatching network-vif-plugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:01:26 user nova-compute[71308]: WARNING nova.compute.manager [req-f330122c-64ec-4870-98d9-312f400ec86e req-686b2658-44a1-48cd-9041-6c8b736b3f4c service nova] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Received unexpected event network-vif-plugged-9c30d673-dfd0-4bd2-ab60-3429b5cd3f92 for instance with vm_state deleted and task_state None.
Apr 14 19:01:26 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:26 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Deleted allocations for instance 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58
Apr 14 19:01:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5f06ab3d-c0cc-4eb2-a1ab-3779136a3f35 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "48e2cdcb-9b4a-458b-95d7-47ef29dd6b58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.460s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:39 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498884.9328887, 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:01:39 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] VM Stopped (Lifecycle Event)
Apr 14 19:01:39 user nova-compute[71308]: DEBUG nova.compute.manager [None req-88b45ade-91db-4902-bf1a-1dd677aa9224 None None] [instance: 48e2cdcb-9b4a-458b-95d7-47ef29dd6b58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:01:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received event network-changed-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Refreshing instance network info cache due to event network-changed-48f196d4-dd0c-4499-8b7b-b0c4199cc059. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:01:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] Acquiring lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:01:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] Acquired lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:01:43 user nova-compute[71308]: DEBUG nova.network.neutron [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Refreshing network info cache for port 48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:01:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updated VIF entry in instance network info cache for port 48f196d4-dd0c-4499-8b7b-b0c4199cc059. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:01:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updating instance_info_cache with network_info: [{"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8cb91de3-61b2-4e09-afd8-f2c87737adeb req-a991aaef-4745-4229-90df-d687a9245d7f service nova] Releasing lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:01:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:01:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:01:49 user nova-compute[71308]: INFO nova.compute.claims [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Claim successful on node user
Apr 14 19:01:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:01:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:01:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:01:50 user nova-compute[71308]: INFO nova.virt.block_device [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Booting with volume 4441ca6a-4e8c-45c6-9669-8db66ae94a39 at /dev/vda
Apr 14 19:01:50 user nova-compute[71308]: DEBUG nova.policy [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55fa4abe2fdd48cb91f39bf8156a7793', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f028a79640b848228dc6e654a0eef49b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG os_brick.utils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[20341efa-7cfe-4d71-bc40-e3e24efef18c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5bd3b6-beea-46d4-aef9-1f6b4472ed4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2506a588-799d-4bfd-9ca4-22faf298d8b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8931d3f-cc9f-430b-aac7-50fc1c689532]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:01:50 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:01:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67ba3ed-e28f-4ab1-8533-556da6292b48]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG os_brick.utils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:01:50 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating existing volume attachment record: 4d431279-2fd1-407b-835d-bd8ffadd95e7 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:01:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Successfully created port: bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:01:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:52 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Successfully updated port: bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:01:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:01:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:01:52 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:01:52 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:01:52 user nova-compute[71308]: DEBUG nova.compute.manager [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-changed-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:52 user nova-compute[71308]: DEBUG nova.compute.manager [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Refreshing instance network info cache due to event network-changed-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:01:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] Acquiring lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:01:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating instance_info_cache with network_info: [{"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:01:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Instance network_info: |[{"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:01:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] Acquired lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:01:53 user nova-compute[71308]: DEBUG nova.network.neutron [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Refreshing network info cache for port bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:01:53 user nova-compute[71308]: DEBUG nova.network.neutron [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updated VIF entry in instance network info cache for port bafdaca1-3fa1-4ec9-93ef-d357c8589ea2. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:01:53 user nova-compute[71308]: DEBUG nova.network.neutron [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating instance_info_cache with network_info: [{"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6a79a401-5df1-4a1d-b1e8-d3e9894f32fd req-cd44e853-872a-4938-af87-adaed90e0e33 service nova] Releasing lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:01:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:56 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:01:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:56 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:01:56 user nova-compute[71308]: INFO nova.compute.claims [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Claim successful on node user
Apr 14 19:01:56 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:01:56 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:01:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:56 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:01:56 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:01:56 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:01:57 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.policy [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f90c8f23e3b42a98fdb9261db65f547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edf25bcc0dea4d3eb1284e8995eb3466', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:01:57 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Creating image(s)
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "/opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "/opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "/opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk 1073741824" returned: 0 in 0.061s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Cannot resize image /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'migration_context' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Ensure instance console log exists: /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:57 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Successfully created port: 08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:01:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:01:59 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Creating image(s)
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Ensure instance console log exists: /opt/stack/data/nova/instances/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Start _get_guest_xml network_info=[{"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '4d431279-2fd1-407b-835d-bd8ffadd95e7', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFKupJlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4a54fb1-bd66-42f5-9f8c-9fb40470f468', 'attached_at': '', 'detached_at': '', 'volume_id': '4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'serial': '4441ca6a-4e8c-45c6-9669-8db66ae94a39'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:01:59 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:01:59 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFKupJlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:01:59 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:01:59 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:01:59 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Successfully updated port: 08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "refresh_cache-15ebad56-cad0-4ab3-853f-72e3a3d2117f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquired lock "refresh_cache-15ebad56-cad0-4ab3-853f-72e3a3d2117f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received event network-changed-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Refreshing instance network info cache due to event network-changed-08acb0d5-2432-42fe-a372-78f11a73ed56. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] Acquiring lock "refresh_cache-15ebad56-cad0-4ab3-853f-72e3a3d2117f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb2d20a-181a-4ee0-8272-abaf82598aba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:01:59 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8408176c-3b7c-4618-adb9-0cbf95bfd8a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39] added
Apr 14 19:01:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[958e841c-3ac8-44e9-a01d-e890cf96619d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a9b53-8548-4d91-8d9b-e90b47b6d430]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFKupJlD {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFKupJlD" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600a7c2-4aef-4dea-9590-e671a7047280]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HFKupJlD'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[602d5e94-d2fa-4a99-be00-446b5de59deb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecff668-5e90-4279-a392-9166b1b9ed10]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:01:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:01:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c4260a-e9ca-43fe-b8c0-2ead9982d627]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260]
Apr 14 19:01:59 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260] successful.
Apr 14 19:01:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3bb7df-45dd-4225-8e4e-377fc6a9107c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfbc892-e000-405f-8e01-ef9ee428066f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:01:59 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:01:59 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7685f890-978e-45a2-91d6-49bebdb6735f]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Updating instance_info_cache with network_info: [{"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Releasing lock "refresh_cache-15ebad56-cad0-4ab3-853f-72e3a3d2117f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Instance network_info: |[{"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] Acquired lock "refresh_cache-15ebad56-cad0-4ab3-853f-72e3a3d2117f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.network.neutron [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Refreshing network info cache for port 08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Start _get_guest_xml network_info=[{"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:01:59 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:01:59 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2038797611',display_name='tempest-AttachVolumeTestJSON-server-2038797611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2038797611',id=37,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8HTfZpcc8mgXo4AFnwhG4K4/O/z3QrzgEBaxKd3TyzfRmFooJLVotAQ5vypXEppo8BUy020ij2j7iBnMQIFDslNGH0Kg+6YUYeTL3M4R8QHGfv3cvG6Xoj82DMjalKAA==',key_name='tempest-keypair-1109149281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-c8djfpah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=15ebad56-cad0-4ab3-853f-72e3a3d2117f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:93:45,bridge_name='br-int',has_traffic_filtering=True,id=08acb0d5-2432-42fe-a372-78f11a73ed56,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb0d5-24') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'pci_devices' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:01:59 user nova-compute[71308]:   <uuid>15ebad56-cad0-4ab3-853f-72e3a3d2117f</uuid>
Apr 14 19:01:59 user nova-compute[71308]:   <name>instance-00000025</name>
Apr 14 19:01:59 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:01:59 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:01:59 user nova-compute[71308]:   <metadata>
Apr 14 19:01:59 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:01:59 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:01:59 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeTestJSON-server-2038797611</nova:name>
Apr 14 19:01:59 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:01:59</nova:creationTime>
Apr 14 19:01:59 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:01:59 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:01:59 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:01:59 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:01:59 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:01:59 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:01:59 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:01:59 user nova-compute[71308]:       <nova:owner>
Apr 14 19:01:59 user nova-compute[71308]:         <nova:user uuid="9f90c8f23e3b42a98fdb9261db65f547">tempest-AttachVolumeTestJSON-1126291015-project-member</nova:user>
Apr 14 19:01:59 user nova-compute[71308]:         <nova:project uuid="edf25bcc0dea4d3eb1284e8995eb3466">tempest-AttachVolumeTestJSON-1126291015</nova:project>
Apr 14 19:01:59 user nova-compute[71308]:       </nova:owner>
Apr 14 19:01:59 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 19:01:59 user nova-compute[71308]:       <nova:ports>
Apr 14 19:01:59 user nova-compute[71308]:         <nova:port uuid="08acb0d5-2432-42fe-a372-78f11a73ed56">
Apr 14 19:01:59 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 19:01:59 user nova-compute[71308]:         </nova:port>
Apr 14 19:01:59 user nova-compute[71308]:       </nova:ports>
Apr 14 19:01:59 user nova-compute[71308]:     </nova:instance>
Apr 14 19:01:59 user nova-compute[71308]:   </metadata>
Apr 14 19:01:59 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:01:59 user nova-compute[71308]:     <system>
Apr 14 19:01:59 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:01:59 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:01:59 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:01:59 user nova-compute[71308]:       <entry name="serial">15ebad56-cad0-4ab3-853f-72e3a3d2117f</entry>
Apr 14 19:01:59 user nova-compute[71308]:       <entry name="uuid">15ebad56-cad0-4ab3-853f-72e3a3d2117f</entry>
Apr 14 19:01:59 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:01:59 user nova-compute[71308]:     </system>
Apr 14 19:01:59 user nova-compute[71308]:   </sysinfo>
Apr 14 19:01:59 user nova-compute[71308]:   <os>
Apr 14 19:01:59 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:01:59 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:01:59 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:01:59 user nova-compute[71308]:   </os>
Apr 14 19:01:59 user nova-compute[71308]:   <features>
Apr 14 19:01:59 user nova-compute[71308]:     <acpi/>
Apr 14 19:01:59 user nova-compute[71308]:     <apic/>
Apr 14 19:01:59 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:01:59 user nova-compute[71308]:   </features>
Apr 14 19:01:59 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:01:59 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:01:59 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:01:59 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:01:59 user nova-compute[71308]:   </clock>
Apr 14 19:01:59 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:01:59 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:01:59 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:01:59 user nova-compute[71308]:   </cpu>
Apr 14 19:01:59 user nova-compute[71308]:   <devices>
Apr 14 19:01:59 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:01:59 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:01:59 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk"/>
Apr 14 19:01:59 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:01:59 user nova-compute[71308]:     </disk>
Apr 14 19:01:59 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:01:59 user nova-compute[71308]:       <mac address="fa:16:3e:f1:93:45"/>
Apr 14 19:01:59 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:01:59 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:01:59 user nova-compute[71308]:       <target dev="tap08acb0d5-24"/>
Apr 14 19:01:59 user nova-compute[71308]:     </interface>
Apr 14 19:01:59 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:01:59 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/console.log" append="off"/>
Apr 14 19:01:59 user nova-compute[71308]:     </serial>
Apr 14 19:01:59 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:01:59 user nova-compute[71308]:     <video>
Apr 14 19:01:59 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:01:59 user nova-compute[71308]:     </video>
Apr 14 19:01:59 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:01:59 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:01:59 user nova-compute[71308]:     </rng>
Apr 14 19:01:59 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:01:59 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:01:59 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:01:59 user nova-compute[71308]:     </memballoon>
Apr 14 19:01:59 user nova-compute[71308]:   </devices>
Apr 14 19:01:59 user nova-compute[71308]: </domain>
Apr 14 19:01:59 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2038797611',display_name='tempest-AttachVolumeTestJSON-server-2038797611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2038797611',id=37,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8HTfZpcc8mgXo4AFnwhG4K4/O/z3QrzgEBaxKd3TyzfRmFooJLVotAQ5vypXEppo8BUy020ij2j7iBnMQIFDslNGH0Kg+6YUYeTL3M4R8QHGfv3cvG6Xoj82DMjalKAA==',key_name='tempest-keypair-1109149281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-c8djfpah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=15ebad56-cad0-4ab3-853f-72e3a3d2117f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:93:45,bridge_name='br-int',has_traffic_filtering=True,id=08acb0d5-2432-42fe-a372-78f11a73ed56,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb0d5-24') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG os_vif [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:93:45,bridge_name='br-int',has_traffic_filtering=True,id=08acb0d5-2432-42fe-a372-78f11a73ed56,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb0d5-24') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08acb0d5-24, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08acb0d5-24, col_values=(('external_ids', {'iface-id': '08acb0d5-2432-42fe-a372-78f11a73ed56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:93:45', 'vm-uuid': '15ebad56-cad0-4ab3-853f-72e3a3d2117f'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:01:59 user nova-compute[71308]: INFO os_vif [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:93:45,bridge_name='br-int',has_traffic_filtering=True,id=08acb0d5-2432-42fe-a372-78f11a73ed56,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb0d5-24')
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:01:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No VIF found with MAC fa:16:3e:f1:93:45, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.network.neutron [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Updated VIF entry in instance network info cache for port 08acb0d5-2432-42fe-a372-78f11a73ed56. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.network.neutron [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Updating instance_info_cache with network_info: [{"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-79de34e8-fc29-4899-a1f7-bdc447be4cb1 req-85ba358b-e513-4ef9-87ab-3365eda9f464 service nova] Releasing lock "refresh_cache-15ebad56-cad0-4ab3-853f-72e3a3d2117f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFKupJlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23463633466633036', 'path': '/dev/sdg'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463633466633036', 'path': '/dev/sdg'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1675664043',display_name='tempest-ServerActionsTestJSON-server-1675664043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1675664043',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-ghhedf08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:01:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=d4a54fb1-bd66-42f5-9f8c-9fb40470f468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'pci_devices' on Instance uuid d4a54fb1-bd66-42f5-9f8c-9fb40470f468 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:02:00 user nova-compute[71308]:   <uuid>d4a54fb1-bd66-42f5-9f8c-9fb40470f468</uuid>
Apr 14 19:02:00 user nova-compute[71308]:   <name>instance-00000024</name>
Apr 14 19:02:00 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:02:00 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:02:00 user nova-compute[71308]:   <metadata>
Apr 14 19:02:00 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:02:00 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:02:00 user nova-compute[71308]:       <nova:name>tempest-ServerActionsTestJSON-server-1675664043</nova:name>
Apr 14 19:02:00 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:01:59</nova:creationTime>
Apr 14 19:02:00 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:02:00 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:02:00 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:02:00 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:02:00 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:02:00 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:02:00 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:02:00 user nova-compute[71308]:       <nova:owner>
Apr 14 19:02:00 user nova-compute[71308]:         <nova:user uuid="55fa4abe2fdd48cb91f39bf8156a7793">tempest-ServerActionsTestJSON-2112054326-project-member</nova:user>
Apr 14 19:02:00 user nova-compute[71308]:         <nova:project uuid="f028a79640b848228dc6e654a0eef49b">tempest-ServerActionsTestJSON-2112054326</nova:project>
Apr 14 19:02:00 user nova-compute[71308]:       </nova:owner>
Apr 14 19:02:00 user nova-compute[71308]:       <nova:ports>
Apr 14 19:02:00 user nova-compute[71308]:         <nova:port uuid="bafdaca1-3fa1-4ec9-93ef-d357c8589ea2">
Apr 14 19:02:00 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 19:02:00 user nova-compute[71308]:         </nova:port>
Apr 14 19:02:00 user nova-compute[71308]:       </nova:ports>
Apr 14 19:02:00 user nova-compute[71308]:     </nova:instance>
Apr 14 19:02:00 user nova-compute[71308]:   </metadata>
Apr 14 19:02:00 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:02:00 user nova-compute[71308]:     <system>
Apr 14 19:02:00 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:02:00 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:02:00 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:02:00 user nova-compute[71308]:       <entry name="serial">d4a54fb1-bd66-42f5-9f8c-9fb40470f468</entry>
Apr 14 19:02:00 user nova-compute[71308]:       <entry name="uuid">d4a54fb1-bd66-42f5-9f8c-9fb40470f468</entry>
Apr 14 19:02:00 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:02:00 user nova-compute[71308]:     </system>
Apr 14 19:02:00 user nova-compute[71308]:   </sysinfo>
Apr 14 19:02:00 user nova-compute[71308]:   <os>
Apr 14 19:02:00 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:02:00 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:02:00 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:02:00 user nova-compute[71308]:   </os>
Apr 14 19:02:00 user nova-compute[71308]:   <features>
Apr 14 19:02:00 user nova-compute[71308]:     <acpi/>
Apr 14 19:02:00 user nova-compute[71308]:     <apic/>
Apr 14 19:02:00 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:02:00 user nova-compute[71308]:   </features>
Apr 14 19:02:00 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:02:00 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:02:00 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:02:00 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:02:00 user nova-compute[71308]:   </clock>
Apr 14 19:02:00 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:02:00 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:02:00 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:02:00 user nova-compute[71308]:   </cpu>
Apr 14 19:02:00 user nova-compute[71308]:   <devices>
Apr 14 19:02:00 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 19:02:00 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:02:00 user nova-compute[71308]:       <source dev="/dev/sdg"/>
Apr 14 19:02:00 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:02:00 user nova-compute[71308]:       <serial>4441ca6a-4e8c-45c6-9669-8db66ae94a39</serial>
Apr 14 19:02:00 user nova-compute[71308]:     </disk>
Apr 14 19:02:00 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:02:00 user nova-compute[71308]:       <mac address="fa:16:3e:9c:b6:c8"/>
Apr 14 19:02:00 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:02:00 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:02:00 user nova-compute[71308]:       <target dev="tapbafdaca1-3f"/>
Apr 14 19:02:00 user nova-compute[71308]:     </interface>
Apr 14 19:02:00 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:02:00 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/console.log" append="off"/>
Apr 14 19:02:00 user nova-compute[71308]:     </serial>
Apr 14 19:02:00 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:02:00 user nova-compute[71308]:     <video>
Apr 14 19:02:00 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:02:00 user nova-compute[71308]:     </video>
Apr 14 19:02:00 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:02:00 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:02:00 user nova-compute[71308]:     </rng>
Apr 14 19:02:00 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:02:00 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:02:00 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:02:00 user nova-compute[71308]:     </memballoon>
Apr 14 19:02:00 user nova-compute[71308]:   </devices>
Apr 14 19:02:00 user nova-compute[71308]: </domain>
Apr 14 19:02:00 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1675664043',display_name='tempest-ServerActionsTestJSON-server-1675664043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1675664043',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-ghhedf08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:01:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=d4a54fb1-bd66-42f5-9f8c-9fb40470f468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG os_vif [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbafdaca1-3f, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbafdaca1-3f, col_values=(('external_ids', {'iface-id': 'bafdaca1-3fa1-4ec9-93ef-d357c8589ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b6:c8', 'vm-uuid': 'd4a54fb1-bd66-42f5-9f8c-9fb40470f468'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:00 user nova-compute[71308]: INFO os_vif [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f')
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:02:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No VIF found with MAC fa:16:3e:9c:b6:c8, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received event network-vif-plugged-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] No waiting events found dispatching network-vif-plugged-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:01 user nova-compute[71308]: WARNING nova.compute.manager [req-9441f3fd-a3f5-4240-b483-506c0fd634c7 req-502def1e-131f-4506-bd21-caa8cdf3a825 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received unexpected event network-vif-plugged-08acb0d5-2432-42fe-a372-78f11a73ed56 for instance with vm_state building and task_state spawning.
Apr 14 19:02:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received event network-vif-plugged-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] No waiting events found dispatching network-vif-plugged-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:03 user nova-compute[71308]: WARNING nova.compute.manager [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received unexpected event network-vif-plugged-08acb0d5-2432-42fe-a372-78f11a73ed56 for instance with vm_state building and task_state spawning.
Apr 14 19:02:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] No waiting events found dispatching network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:03 user nova-compute[71308]: WARNING nova.compute.manager [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received unexpected event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance with vm_state building and task_state spawning.
Apr 14 19:02:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:03 user nova-compute[71308]: DEBUG nova.compute.manager [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] No waiting events found dispatching network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:03 user nova-compute[71308]: WARNING nova.compute.manager [req-78bf8976-81c1-4bb4-ba8d-db604d1f742e req-e13eb429-8824-4917-8206-b2b108bdfcd3 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received unexpected event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance with vm_state building and task_state spawning.
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498924.8002863, 15ebad56-cad0-4ab3-853f-72e3a3d2117f => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] VM Resumed (Lifecycle Event)
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Instance spawned successfully.
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Instance spawned successfully.
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498924.8004763, 15ebad56-cad0-4ab3-853f-72e3a3d2117f => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] VM Started (Lifecycle Event)
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Took 7.72 seconds to spawn the instance on the hypervisor.
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Took 5.84 seconds to spawn the instance on the hypervisor.
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498924.8035114, d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] VM Resumed (Lifecycle Event)
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:02:04 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498924.806703, d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:02:04 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] VM Started (Lifecycle Event)
Apr 14 19:02:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:05 user nova-compute[71308]: INFO nova.compute.manager [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Took 8.96 seconds to build instance.
Apr 14 19:02:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:02:05 user nova-compute[71308]: INFO nova.compute.manager [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Took 15.33 seconds to build instance.
Apr 14 19:02:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e7d8c65e-ec29-4d8d-999b-4b6de1ce4069 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.061s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7ec845a0-3a93-4955-b010-3b3cfdd53d35 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.430s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:09 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:02:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:12 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:13 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:02:16 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:02:16 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:02:16 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7349MB free_disk=26.042007446289062GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:02:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 97aafe40-5587-41cf-ba75-6077d9daa7eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1feb4399-a5dc-43a7-ac78-4d22809e2737 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 56097076-1e63-41ba-8331-be8ede06c537 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 05891511-e84c-4fe3-a688-edcc27849d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 46d51513-1995-43c5-976a-40789ae575f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 698bc2dc-aff4-4148-b80e-8b77c846faf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=2304MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing inventories for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating ProviderTree inventory for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating inventory in ProviderTree for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing aggregate associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, aggregates: None {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing trait associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:02:17 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:02:18 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:02:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.096s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 19:02:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] There are 0 instances to clean {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 19:02:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updating instance_info_cache with network_info: [{"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-23d14a51-41aa-4827-bd60-c605d9689bc8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71308) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "97aafe40-5587-41cf-ba75-6077d9daa7eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:22 user nova-compute[71308]: INFO nova.compute.manager [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Terminating instance
Apr 14 19:02:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received event network-vif-unplugged-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] Acquiring lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] No waiting events found dispatching network-vif-unplugged-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-512597fc-8461-488a-9496-5f2e38d17f77 req-dbcf3a61-5fb4-4c8b-be02-212797e6d5c2 service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received event network-vif-unplugged-00a6b78f-1816-4b0f-956b-3dc23b029449 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:02:22 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Instance destroyed successfully.
Apr 14 19:02:22 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lazy-loading 'resources' on Instance uuid 97aafe40-5587-41cf-ba75-6077d9daa7eb {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1765673248',display_name='tempest-ServersNegativeTestJSON-server-1765673248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1765673248',id=24,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:53:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4af68184e7654efea3187e05bb10e5e4',ramdisk_id='',reservation_id='r-jzmw4qv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1532814906',owner_user_name='tempest-ServersNegativeTestJSON-1532814906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:53:43Z,user_data=None,user_id='008a24026e844252b0be1268461bc2b1',uuid=97aafe40-5587-41cf-ba75-6077d9daa7eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converting VIF {"id": "00a6b78f-1816-4b0f-956b-3dc23b029449", "address": "fa:16:3e:b7:b6:23", "network": {"id": "7c02047b-1b40-4937-ac05-13accc969b21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-444864292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4af68184e7654efea3187e05bb10e5e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00a6b78f-18", "ovs_interfaceid": "00a6b78f-1816-4b0f-956b-3dc23b029449", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b6:23,bridge_name='br-int',has_traffic_filtering=True,id=00a6b78f-1816-4b0f-956b-3dc23b029449,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a6b78f-18') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG os_vif [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b6:23,bridge_name='br-int',has_traffic_filtering=True,id=00a6b78f-1816-4b0f-956b-3dc23b029449,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a6b78f-18') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00a6b78f-18, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:02:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:22 user nova-compute[71308]: INFO os_vif [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:b6:23,bridge_name='br-int',has_traffic_filtering=True,id=00a6b78f-1816-4b0f-956b-3dc23b029449,network=Network(7c02047b-1b40-4937-ac05-13accc969b21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00a6b78f-18')
Apr 14 19:02:22 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Deleting instance files /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb_del
Apr 14 19:02:22 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Deletion of /opt/stack/data/nova/instances/97aafe40-5587-41cf-ba75-6077d9daa7eb_del complete
Apr 14 19:02:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 19:02:23 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:23 user nova-compute[71308]: INFO nova.compute.manager [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Terminating instance
Apr 14 19:02:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-changed-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Refreshing instance network info cache due to event network-changed-99fafc78-521b-4f9c-81fe-9571483238c1. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] Acquiring lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] Acquired lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG nova.network.neutron [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Refreshing network info cache for port 99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:23 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:02:23 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Took 0.94 seconds to deallocate network for instance.
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-41d23025-824d-400c-88b1-0ef6eb31bed2 req-95448242-98cb-4117-97ed-7e3df347754d service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received event network-vif-deleted-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Instance destroyed successfully.
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lazy-loading 'resources' on Instance uuid 1feb4399-a5dc-43a7-ac78-4d22809e2737 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:55:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1245634344',display_name='tempest-TestStampPattern-server-1245634344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1245634344',id=26,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx8M4QjbAb47cqa0IIK3DFtHC++DW5qjEMCJfo5EDtvaO/cl4OHImq2UJzNJC1zQSEajn+k79i0pWkmV4FFQZ3qK1iN0DjaB8oxSduo8LZXNaMWp9839OvzlCknJnwL1A==',key_name='tempest-TestStampPattern-580300982',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='921435d84194431c886ec1ed1848d4d6',ramdisk_id='',reservation_id='r-24tjymju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-251531447',owner_user_name='tempest-TestStampPattern-251531447-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:58:25Z,user_data=None,user_id='9a9414d0c24643fdb162aad828c736bd',uuid=1feb4399-a5dc-43a7-ac78-4d22809e2737,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converting VIF {"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:b8:29,bridge_name='br-int',has_traffic_filtering=True,id=99fafc78-521b-4f9c-81fe-9571483238c1,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99fafc78-52') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG os_vif [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:b8:29,bridge_name='br-int',has_traffic_filtering=True,id=99fafc78-521b-4f9c-81fe-9571483238c1,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99fafc78-52') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99fafc78-52, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:02:24 user nova-compute[71308]: INFO os_vif [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:b8:29,bridge_name='br-int',has_traffic_filtering=True,id=99fafc78-521b-4f9c-81fe-9571483238c1,network=Network(1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99fafc78-52')
Apr 14 19:02:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Deleting instance files /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737_del
Apr 14 19:02:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Deletion of /opt/stack/data/nova/instances/1feb4399-a5dc-43a7-ac78-4d22809e2737_del complete
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:02:24 user nova-compute[71308]: INFO nova.compute.manager [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 19:02:24 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received event network-vif-plugged-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] Acquiring lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.compute.manager [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] No waiting events found dispatching network-vif-plugged-00a6b78f-1816-4b0f-956b-3dc23b029449 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:24 user nova-compute[71308]: WARNING nova.compute.manager [req-5385fbca-04e0-4c04-98a4-ce69c0098384 req-a627acce-867a-4b57-bad5-9a5852b8af4b service nova] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Received unexpected event network-vif-plugged-00a6b78f-1816-4b0f-956b-3dc23b029449 for instance with vm_state deleted and task_state None.
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Updated VIF entry in instance network info cache for port 99fafc78-521b-4f9c-81fe-9571483238c1. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Updating instance_info_cache with network_info: [{"id": "99fafc78-521b-4f9c-81fe-9571483238c1", "address": "fa:16:3e:be:b8:29", "network": {"id": "1fee8f21-9288-4bdf-9ecb-4c9e70bb9d37", "bridge": "br-int", "label": "tempest-TestStampPattern-37270885-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "921435d84194431c886ec1ed1848d4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99fafc78-52", "ovs_interfaceid": "99fafc78-521b-4f9c-81fe-9571483238c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1c05ef3-dc36-4907-b48d-49f26e849e2b req-39506ecc-2c16-442e-8efa-707794b78cf9 service nova] Releasing lock "refresh_cache-1feb4399-a5dc-43a7-ac78-4d22809e2737" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:24 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Deleted allocations for instance 97aafe40-5587-41cf-ba75-6077d9daa7eb
Apr 14 19:02:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d633dc32-d4ad-4fef-8611-cdf9ae904cc7 tempest-ServersNegativeTestJSON-1532814906 tempest-ServersNegativeTestJSON-1532814906-project-member] Lock "97aafe40-5587-41cf-ba75-6077d9daa7eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.607s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:25 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:02:25 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Took 1.20 seconds to deallocate network for instance.
Apr 14 19:02:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-vif-unplugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] No waiting events found dispatching network-vif-unplugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:26 user nova-compute[71308]: WARNING nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received unexpected event network-vif-unplugged-99fafc78-521b-4f9c-81fe-9571483238c1 for instance with vm_state deleted and task_state None.
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] No waiting events found dispatching network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:26 user nova-compute[71308]: WARNING nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received unexpected event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 for instance with vm_state deleted and task_state None.
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] No waiting events found dispatching network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:26 user nova-compute[71308]: WARNING nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received unexpected event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 for instance with vm_state deleted and task_state None.
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Acquiring lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] No waiting events found dispatching network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:26 user nova-compute[71308]: WARNING nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received unexpected event network-vif-plugged-99fafc78-521b-4f9c-81fe-9571483238c1 for instance with vm_state deleted and task_state None.
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-55a6d102-8cf0-44ee-9146-d9b96c244150 req-a80e24b7-4d79-4921-9a2c-5e77354244cb service nova] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Received event network-vif-deleted-99fafc78-521b-4f9c-81fe-9571483238c1 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:26 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Deleted allocations for instance 1feb4399-a5dc-43a7-ac78-4d22809e2737
Apr 14 19:02:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d70c0a58-3110-4b16-b037-440537614e33 tempest-TestStampPattern-251531447 tempest-TestStampPattern-251531447-project-member] Lock "1feb4399-a5dc-43a7-ac78-4d22809e2737" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.751s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:35 user nova-compute[71308]: INFO nova.compute.manager [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Terminating instance
Apr 14 19:02:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-unplugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] No waiting events found dispatching network-vif-unplugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-efa887ee-2462-4230-9c92-12a25e53e725 req-b87de3cb-a92a-4799-94b3-d373dd66102d service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-unplugged-dc45a89d-f20f-49e4-a526-0355bb98b37f for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Instance destroyed successfully.
Apr 14 19:02:35 user nova-compute[71308]: DEBUG nova.objects.instance [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'resources' on Instance uuid 698bc2dc-aff4-4148-b80e-8b77c846faf7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:00:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-263545530',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-263545530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-263545530',id=35,image_ref='ff35c27c-c625-4fb5-b0ea-54a8464c1258',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-d1dz9x9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1560263906',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:01:01Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=698bc2dc-aff4-4148-b80e-8b77c846faf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "address": "fa:16:3e:03:90:4f", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc45a89d-f2", "ovs_interfaceid": "dc45a89d-f20f-49e4-a526-0355bb98b37f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:90:4f,bridge_name='br-int',has_traffic_filtering=True,id=dc45a89d-f20f-49e4-a526-0355bb98b37f,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc45a89d-f2') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_vif [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:90:4f,bridge_name='br-int',has_traffic_filtering=True,id=dc45a89d-f20f-49e4-a526-0355bb98b37f,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc45a89d-f2') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc45a89d-f2, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:02:35 user nova-compute[71308]: INFO os_vif [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:90:4f,bridge_name='br-int',has_traffic_filtering=True,id=dc45a89d-f20f-49e4-a526-0355bb98b37f,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc45a89d-f2')
Apr 14 19:02:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMPSGHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:02:35 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea508d31-0aa5-42d3-91d0-d2dcb71482a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:02:35 user nova-compute[71308]: No targets found.
Apr 14 19:02:35 user nova-compute[71308]: iSNS:
Apr 14 19:02:35 user nova-compute[71308]: No targets found.
Apr 14 19:02:35 user nova-compute[71308]: STATIC:
Apr 14 19:02:35 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:02:35 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:02:35 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:02:35 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d
Apr 14 19:02:35 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:02:35 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:02:35 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa
Apr 14 19:02:35 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:02:35 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:02:35 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9
Apr 14 19:02:35 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:02:35 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:02:35 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb
Apr 14 19:02:35 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:02:35 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:02:35 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 19:02:35 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:02:35 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:02:35 user nova-compute[71308]: FIRMWARE:
Apr 14 19:02:35 user nova-compute[71308]: No targets found.
Apr 14 19:02:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:02:35 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:02:35 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be1667-1166-4784-8071-368a33619fc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a107680-4ca9-47d9-95ad-d52cb4d79667]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:02:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:02:35 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:02:35 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22542d9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88f7796-efbb-4328-8603-8c49964ae986]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:35 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[30767673-b704-4d74-a60b-a56590f55dc3]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efa9486-719c-4e94-8879-d15d6fa38084]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ad411d-5aca-4663-b79c-f41f3fec4a24]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23236323338313665', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c598ee8c', '/dev/disk/by-id/scsi-1SCST_BIOc598ee8c-2623816ea9b13f4f') {{(pid=81547) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 19:02:36 user nova-compute[71308]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23236323338313665
Apr 14 19:02:36 user nova-compute[71308]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c598ee8c
Apr 14 19:02:36 user nova-compute[71308]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc598ee8c-2623816ea9b13f4f
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aef0c20-c721-455f-90cb-5d9f086c1f69]: (4, None) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8aab8f-f78a-408a-a7b4-94ce9b12a2b2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9753cce-fae3-4fa8-9fec-4f1316066a16]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa, portal: 172.16.0.220,3260]
Apr 14 19:02:36 user nova-compute[71308]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa, portal: 172.16.0.220,3260] successful.
Apr 14 19:02:36 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcaf731-7799-409b-a5fa-956cb7fcb856]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.454s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== disconnect_volume: return (456ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:02:36 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Deleting instance files /opt/stack/data/nova/instances/698bc2dc-aff4-4148-b80e-8b77c846faf7_del
Apr 14 19:02:36 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Deletion of /opt/stack/data/nova/instances/698bc2dc-aff4-4148-b80e-8b77c846faf7_del complete
Apr 14 19:02:36 user nova-compute[71308]: INFO nova.compute.manager [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Took 1.38 seconds to destroy the instance on the hypervisor.
Apr 14 19:02:36 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:02:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] No waiting events found dispatching network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:37 user nova-compute[71308]: WARNING nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received unexpected event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f for instance with vm_state active and task_state deleting.
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] No waiting events found dispatching network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:37 user nova-compute[71308]: WARNING nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received unexpected event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f for instance with vm_state active and task_state deleting.
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] No waiting events found dispatching network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:37 user nova-compute[71308]: WARNING nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received unexpected event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f for instance with vm_state active and task_state deleting.
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-unplugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] No waiting events found dispatching network-vif-unplugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-fe95504e-18f5-40ee-b950-c3a04fee41c7 req-938ffb77-bb44-4b87-a06a-587ed9854768 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-unplugged-dc45a89d-f20f-49e4-a526-0355bb98b37f for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:02:37 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Took 1.15 seconds to deallocate network for instance.
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498942.9362102, 97aafe40-5587-41cf-ba75-6077d9daa7eb => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:02:37 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] VM Stopped (Lifecycle Event)
Apr 14 19:02:37 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7e2fca56-d39d-440f-b8ee-b989ee02f624 None None] [instance: 97aafe40-5587-41cf-ba75-6077d9daa7eb] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:38 user nova-compute[71308]: INFO nova.compute.manager [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Took 1.04 seconds to detach 1 volumes for instance.
Apr 14 19:02:38 user nova-compute[71308]: DEBUG nova.compute.manager [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Deleting volume: 6a0bf6a1-4a2d-4cd8-8a3f-6086c27eedaa {{(pid=71308) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 19:02:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:38 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:39 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:02:39 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:02:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:39 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Deleted allocations for instance 698bc2dc-aff4-4148-b80e-8b77c846faf7
Apr 14 19:02:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-e997e2ee-1130-443d-a4ad-4ac4ac613c6d tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.237s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:39 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498944.3839674, 1feb4399-a5dc-43a7-ac78-4d22809e2737 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:02:39 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] VM Stopped (Lifecycle Event)
Apr 14 19:02:39 user nova-compute[71308]: DEBUG nova.compute.manager [None req-12d2d750-c7be-4f95-b1a9-4b1b0d72ab40 None None] [instance: 1feb4399-a5dc-43a7-ac78-4d22809e2737] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:39 user nova-compute[71308]: DEBUG nova.compute.manager [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] Acquiring lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] Lock "698bc2dc-aff4-4148-b80e-8b77c846faf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:39 user nova-compute[71308]: DEBUG nova.compute.manager [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] No waiting events found dispatching network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:39 user nova-compute[71308]: WARNING nova.compute.manager [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received unexpected event network-vif-plugged-dc45a89d-f20f-49e4-a526-0355bb98b37f for instance with vm_state deleted and task_state None.
Apr 14 19:02:39 user nova-compute[71308]: DEBUG nova.compute.manager [req-d7a8987b-d701-4032-89be-2dd7c9c6ed00 req-1be8e99a-9313-4501-b811-704b3adf8273 service nova] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Received event network-vif-deleted-dc45a89d-f20f-49e4-a526-0355bb98b37f {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:02:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:50 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498955.7487237, 698bc2dc-aff4-4148-b80e-8b77c846faf7 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:02:50 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] VM Stopped (Lifecycle Event)
Apr 14 19:02:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-670a442b-6717-4f23-a252-4b898484e4fb None None] [instance: 698bc2dc-aff4-4148-b80e-8b77c846faf7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:51 user nova-compute[71308]: INFO nova.compute.manager [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Unrescuing
Apr 14 19:02:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquired lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating instance_info_cache with network_info: [{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Releasing lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG nova.objects.instance [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'flavor' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-unplugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-unplugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:51 user nova-compute[71308]: WARNING nova.compute.manager [req-9656608a-eaf5-4707-9c8d-c32bb5be34ae req-b9a98108-0752-4540-877f-f44107b3f9a2 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-unplugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state rescued and task_state unrescuing.
Apr 14 19:02:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:51 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:02:52 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Instance destroyed successfully.
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 6e79e2cb-54c5-487e-b852-49303ee3e3cc {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 56097076-1e63-41ba-8331-be8ede06c537 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 46d51513-1995-43c5-976a-40789ae575f1 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid d4a54fb1-bd66-42f5-9f8c-9fb40470f468 {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Triggering sync for uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "1d305ab4-1813-4728-a01c-287e521a05ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "56097076-1e63-41ba-8331-be8ede06c537" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "56097076-1e63-41ba-8331-be8ede06c537" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "05891511-e84c-4fe3-a688-edcc27849d58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: INFO nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "05891511-e84c-4fe3-a688-edcc27849d58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "46d51513-1995-43c5-976a-40789ae575f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "46d51513-1995-43c5-976a-40789ae575f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "1d305ab4-1813-4728-a01c-287e521a05ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "56097076-1e63-41ba-8331-be8ede06c537" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "46d51513-1995-43c5-976a-40789ae575f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:53 user nova-compute[71308]: WARNING nova.compute.manager [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state rescued and task_state unrescuing.
Apr 14 19:02:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:53 user nova-compute[71308]: WARNING nova.compute.manager [req-a3edc6f9-4401-4138-8d60-dcb8de4bd165 req-f8852982-1c96-4019-a354-c3efd82f6aee service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state rescued and task_state unrescuing.
Apr 14 19:02:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-da4da2a9-475b-4657-b085-162a0c5333ba tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for 05891511-e84c-4fe3-a688-edcc27849d58 due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498975.724501, 05891511-e84c-4fe3-a688-edcc27849d58 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:02:55 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] VM Resumed (Lifecycle Event)
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:02:55 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681498975.7246616, 05891511-e84c-4fe3-a688-edcc27849d58 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:02:55 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] VM Started (Lifecycle Event)
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:02:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:02:55 user nova-compute[71308]: WARNING nova.compute.manager [req-6c7516ca-c960-468d-a3c5-b4e64c5ff7dd req-31cb13b1-8c0f-41eb-a55e-3fd4f4a9865a service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state active and task_state None.
Apr 14 19:02:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:05 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:03:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:03:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:07 user nova-compute[71308]: INFO nova.compute.manager [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Terminating instance
Apr 14 19:03:07 user nova-compute[71308]: DEBUG nova.compute.manager [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-unplugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-unplugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-4af84f30-d977-46e7-a597-6b6f7dc8eb3e req-ec253b56-7f0f-4547-af40-dc0089cf515a service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-unplugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Instance destroyed successfully.
Apr 14 19:03:08 user nova-compute[71308]: DEBUG nova.objects.instance [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'resources' on Instance uuid 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:57:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1753583208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1753583208',id=30,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-7fe4io26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:01:22Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "3a14f42c-2105-477c-8012-069d489f2d91", "address": "fa:16:3e:bc:fb:c2", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a14f42c-21", "ovs_interfaceid": "3a14f42c-2105-477c-8012-069d489f2d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:fb:c2,bridge_name='br-int',has_traffic_filtering=True,id=3a14f42c-2105-477c-8012-069d489f2d91,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a14f42c-21') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_vif [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:fb:c2,bridge_name='br-int',has_traffic_filtering=True,id=3a14f42c-2105-477c-8012-069d489f2d91,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a14f42c-21') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a14f42c-21, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:03:08 user nova-compute[71308]: INFO os_vif [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:fb:c2,bridge_name='br-int',has_traffic_filtering=True,id=3a14f42c-2105-477c-8012-069d489f2d91,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a14f42c-21')
Apr 14 19:03:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyaEeBsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:03:08 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6385562-3f7b-4d8e-8391-11633ac0e8ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:03:08 user nova-compute[71308]: No targets found.
Apr 14 19:03:08 user nova-compute[71308]: iSNS:
Apr 14 19:03:08 user nova-compute[71308]: No targets found.
Apr 14 19:03:08 user nova-compute[71308]: STATIC:
Apr 14 19:03:08 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:03:08 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:08 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:08 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d
Apr 14 19:03:08 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:08 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:08 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9
Apr 14 19:03:08 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:08 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:08 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb
Apr 14 19:03:08 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:08 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:08 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 19:03:08 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:08 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:08 user nova-compute[71308]: FIRMWARE:
Apr 14 19:03:08 user nova-compute[71308]: No targets found.
Apr 14 19:03:08 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:03:08 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:03:08 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2576f8cc-41e0-410e-a246-f432a4859421]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28426ae-f86b-44fd-8795-2968350e94ab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:08 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:03:08 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:03:08 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:08 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:08 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:08 user nova-compute[71308]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 (non-flash)
Apr 14 19:03:08 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:03:08 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:08 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:08 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2274168b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[80370174-f41b-4f8f-8c59-45997a98937c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7598087d-c6f0-4169-b295-8115973dc6cd]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd0fb18-b684-4c04-ba89-852b67d36426]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[39940af7-ac3d-47b9-a559-42eb056ddaed]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2b4e1b51',) {{(pid=81547) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db01deb-ec1b-476b-872c-78a9020eb4b4]: (4, None) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2106376-3202-4103-861e-d1b5950a942a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:08 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7369a105-f45e-4f08-a828-401d16424336]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9, portal: 172.16.0.220,3260]
Apr 14 19:03:09 user nova-compute[71308]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9, portal: 172.16.0.220,3260] successful.
Apr 14 19:03:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e0fe34-9aba-4c9b-9fa6-18333cbc07b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5695f38a-50e1-4e40-bf80-2459da3ed794]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] <== disconnect_volume: return (310ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:03:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Deleting instance files /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1_del
Apr 14 19:03:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Deletion of /opt/stack/data/nova/instances/1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1_del complete
Apr 14 19:03:09 user nova-compute[71308]: INFO nova.compute.manager [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 14 19:03:09 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:03:09 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:09 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Took 0.53 seconds to deallocate network for instance.
Apr 14 19:03:09 user nova-compute[71308]: DEBUG nova.compute.manager [req-8d90d497-1f51-40c7-adfc-3174991a97a6 req-6fe95b3a-fe4c-4c03-8f08-2ba3644f0a1c service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-deleted-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] Acquiring lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] No waiting events found dispatching network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:10 user nova-compute[71308]: WARNING nova.compute.manager [req-f39fca00-05a5-44f7-8f47-c2a4aa7a152f req-ef0e9e31-8106-45c4-bdf4-90d6228706c8 service nova] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Received unexpected event network-vif-plugged-3a14f42c-2105-477c-8012-069d489f2d91 for instance with vm_state active and task_state deleting.
Apr 14 19:03:10 user nova-compute[71308]: INFO nova.compute.manager [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 19:03:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:10 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Deleted allocations for instance 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1
Apr 14 19:03:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-3e84d0e7-46f1-4273-9784-1cb2511a1b1f tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.969s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:03:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:03:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:03:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:03:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:03:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:13 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:03:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:03:17 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:03:17 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7674MB free_disk=26.149723052978516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 56097076-1e63-41ba-8331-be8ede06c537 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 05891511-e84c-4fe3-a688-edcc27849d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 46d51513-1995-43c5-976a-40789ae575f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:03:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:03:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:03:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:03:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:03:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:03:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:20 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:03:21 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updating instance_info_cache with network_info: [{"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-1d305ab4-1813-4728-a01c-287e521a05ec" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:03:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:23 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681498988.6935463, 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:03:23 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] VM Stopped (Lifecycle Event)
Apr 14 19:03:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-0c345e78-b89d-4125-ae9e-f18ae1c74338 None None] [instance: 1cd5d635-b9f4-4aa9-80b8-0d6acfc326b1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:03:28 user nova-compute[71308]: INFO nova.compute.claims [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Claim successful on node user
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.network.neutron [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:03:28 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:03:28 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Creating image(s)
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.policy [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "56097076-1e63-41ba-8331-be8ede06c537" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "56097076-1e63-41ba-8331-be8ede06c537" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "56097076-1e63-41ba-8331-be8ede06c537-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:28 user nova-compute[71308]: INFO nova.compute.manager [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Terminating instance
Apr 14 19:03:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk 1073741824" returned: 0 in 0.049s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received event network-vif-unplugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] Acquiring lock "56097076-1e63-41ba-8331-be8ede06c537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] No waiting events found dispatching network-vif-unplugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-5be60de9-7e70-410c-a5d1-5462296c4f34 req-cb520343-a5a8-4021-8a77-c8209d34e66b service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received event network-vif-unplugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Cannot resize image /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'migration_context' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Ensure instance console log exists: /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Instance destroyed successfully.
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.objects.instance [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'resources' on Instance uuid 56097076-1e63-41ba-8331-be8ede06c537 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-889981772',display_name='tempest-TestVolumeBootPattern-volume-backed-server-889981772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-889981772',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:59:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-20efi3zr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:59:02Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=56097076-1e63-41ba-8331-be8ede06c537,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "address": "fa:16:3e:f2:19:1c", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf28ad1a5-c4", "ovs_interfaceid": "f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:1c,bridge_name='br-int',has_traffic_filtering=True,id=f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28ad1a5-c4') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_vif [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:1c,bridge_name='br-int',has_traffic_filtering=True,id=f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28ad1a5-c4') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf28ad1a5-c4, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:03:29 user nova-compute[71308]: INFO os_vif [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:1c,bridge_name='br-int',has_traffic_filtering=True,id=f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf28ad1a5-c4')
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWQZRKwb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:03:29 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c922a2fd-5894-4138-aa1b-5721c5039188]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:03:29 user nova-compute[71308]: No targets found.
Apr 14 19:03:29 user nova-compute[71308]: iSNS:
Apr 14 19:03:29 user nova-compute[71308]: No targets found.
Apr 14 19:03:29 user nova-compute[71308]: STATIC:
Apr 14 19:03:29 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:03:29 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:29 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:29 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d
Apr 14 19:03:29 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:29 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:29 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb
Apr 14 19:03:29 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:29 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:29 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 19:03:29 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:29 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:29 user nova-compute[71308]: FIRMWARE:
Apr 14 19:03:29 user nova-compute[71308]: No targets found.
Apr 14 19:03:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:03:29 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:03:29 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7db3ac1-7715-4cba-acc4-e883db2d0eb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0712b4a-7a13-4fb0-84d8-94d3c7624188]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:29 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:03:29 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:29 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:29 user nova-compute[71308]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d (non-flash)
Apr 14 19:03:29 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:29 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227a90c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d'): ({'sde'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Removing single pathed devices sde {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[04091224-343d-4ea4-8d00-e2c2691b9bd6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[918b424f-0b88-487b-afb7-34713017f6db]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flushing IO for device /dev/sde {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33a64d0-172a-4f82-8f64-6440713a0923]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[41350a83-e1ed-447c-99ec-23a8b7670e31]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb81e296-c221-4a84-b5e1-a4f0d9cf8788]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c07a79-1804-4faf-b900-cd2f2dd7ae45]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d, portal: 172.16.0.220,3260]
Apr 14 19:03:29 user nova-compute[71308]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d, portal: 172.16.0.220,3260] successful.
Apr 14 19:03:29 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ea013c-1c59-46c4-b9be-9feb9dd5409d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e27627-f057-4a98-8095-1f508b8620ce]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== disconnect_volume: return (337ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:03:29 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:03:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Deleting instance files /opt/stack/data/nova/instances/56097076-1e63-41ba-8331-be8ede06c537_del
Apr 14 19:03:29 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Deletion of /opt/stack/data/nova/instances/56097076-1e63-41ba-8331-be8ede06c537_del complete
Apr 14 19:03:30 user nova-compute[71308]: INFO nova.compute.manager [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 14 19:03:30 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:03:30 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:03:30 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 56097076-1e63-41ba-8331-be8ede06c537] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:03:30 user nova-compute[71308]: DEBUG nova.network.neutron [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Successfully created port: fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:03:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received event network-vif-plugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] Acquiring lock "56097076-1e63-41ba-8331-be8ede06c537-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] Lock "56097076-1e63-41ba-8331-be8ede06c537-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] No waiting events found dispatching network-vif-plugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:31 user nova-compute[71308]: WARNING nova.compute.manager [req-c0dd8663-8c81-40ef-befd-2c226dfe2dc2 req-60f76e07-5e01-43b1-9006-3c2e6a6d35dc service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received unexpected event network-vif-plugged-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a for instance with vm_state active and task_state deleting.
Apr 14 19:03:31 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Received event network-vif-deleted-f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:31 user nova-compute[71308]: INFO nova.compute.manager [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Neutron deleted interface f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a; detaching it from the instance and deleting it from the info cache
Apr 14 19:03:31 user nova-compute[71308]: DEBUG nova.network.neutron [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:31 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Took 1.68 seconds to deallocate network for instance.
Apr 14 19:03:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-1d41d8bb-51ad-43b6-8c52-c5dd0c3a1249 req-6986d14c-e0fd-4e9a-bd6d-2fc23a3c1469 service nova] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Detach interface failed, port_id=f28ad1a5-c4c2-42d0-81d0-b45a4a7a6a6a, reason: Instance 56097076-1e63-41ba-8331-be8ede06c537 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.network.neutron [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Successfully updated port: fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquired lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.network.neutron [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.network.neutron [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:03:32 user nova-compute[71308]: INFO nova.compute.manager [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Deleting volume: 84ea013c-1c59-46c4-b9be-9feb9dd5409d {{(pid=71308) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.network.neutron [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating instance_info_cache with network_info: [{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Releasing lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance network_info: |[{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Start _get_guest_xml network_info=[{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:03:32 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:03:32 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1127447025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1127447025',id=38,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMie4jk+eKDDeaE+UlFjfMzkkdZn5tHrG2pp7P8c6d+PQZvYazMq2yTH5MI/VepSyomDJZZ/cTr9HacR1kMWge6kZ4qBZES1sp1DTJQpGt0DwmP8idMT1Qs9zoNJj5wRSQ==',key_name='tempest-keypair-1365704596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-e2gxcjgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=179270ef-7866-4ee7-af13-ec3ea5e7525a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.objects.instance [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'pci_devices' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:03:32 user nova-compute[71308]:   <uuid>179270ef-7866-4ee7-af13-ec3ea5e7525a</uuid>
Apr 14 19:03:32 user nova-compute[71308]:   <name>instance-00000026</name>
Apr 14 19:03:32 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:03:32 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:03:32 user nova-compute[71308]:   <metadata>
Apr 14 19:03:32 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:03:32 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:03:32 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1127447025</nova:name>
Apr 14 19:03:32 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:03:32</nova:creationTime>
Apr 14 19:03:32 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:03:32 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:03:32 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:03:32 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:03:32 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:03:32 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:03:32 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:03:32 user nova-compute[71308]:       <nova:owner>
Apr 14 19:03:32 user nova-compute[71308]:         <nova:user uuid="716e5499c6eb483e9c88fd25606018d9">tempest-AttachVolumeShelveTestJSON-1405261713-project-member</nova:user>
Apr 14 19:03:32 user nova-compute[71308]:         <nova:project uuid="ebb0956418bd462c84e1392a74b5ae2e">tempest-AttachVolumeShelveTestJSON-1405261713</nova:project>
Apr 14 19:03:32 user nova-compute[71308]:       </nova:owner>
Apr 14 19:03:32 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 19:03:32 user nova-compute[71308]:       <nova:ports>
Apr 14 19:03:32 user nova-compute[71308]:         <nova:port uuid="fef01e15-9070-4b0b-ba18-0b9540774cb9">
Apr 14 19:03:32 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 19:03:32 user nova-compute[71308]:         </nova:port>
Apr 14 19:03:32 user nova-compute[71308]:       </nova:ports>
Apr 14 19:03:32 user nova-compute[71308]:     </nova:instance>
Apr 14 19:03:32 user nova-compute[71308]:   </metadata>
Apr 14 19:03:32 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:03:32 user nova-compute[71308]:     <system>
Apr 14 19:03:32 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:03:32 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:03:32 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:03:32 user nova-compute[71308]:       <entry name="serial">179270ef-7866-4ee7-af13-ec3ea5e7525a</entry>
Apr 14 19:03:32 user nova-compute[71308]:       <entry name="uuid">179270ef-7866-4ee7-af13-ec3ea5e7525a</entry>
Apr 14 19:03:32 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:03:32 user nova-compute[71308]:     </system>
Apr 14 19:03:32 user nova-compute[71308]:   </sysinfo>
Apr 14 19:03:32 user nova-compute[71308]:   <os>
Apr 14 19:03:32 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:03:32 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:03:32 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:03:32 user nova-compute[71308]:   </os>
Apr 14 19:03:32 user nova-compute[71308]:   <features>
Apr 14 19:03:32 user nova-compute[71308]:     <acpi/>
Apr 14 19:03:32 user nova-compute[71308]:     <apic/>
Apr 14 19:03:32 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:03:32 user nova-compute[71308]:   </features>
Apr 14 19:03:32 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:03:32 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:03:32 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:03:32 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:03:32 user nova-compute[71308]:   </clock>
Apr 14 19:03:32 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:03:32 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:03:32 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:03:32 user nova-compute[71308]:   </cpu>
Apr 14 19:03:32 user nova-compute[71308]:   <devices>
Apr 14 19:03:32 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:03:32 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:03:32 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk"/>
Apr 14 19:03:32 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:03:32 user nova-compute[71308]:     </disk>
Apr 14 19:03:32 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:03:32 user nova-compute[71308]:       <mac address="fa:16:3e:f5:25:ae"/>
Apr 14 19:03:32 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:03:32 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:03:32 user nova-compute[71308]:       <target dev="tapfef01e15-90"/>
Apr 14 19:03:32 user nova-compute[71308]:     </interface>
Apr 14 19:03:32 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:03:32 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/console.log" append="off"/>
Apr 14 19:03:32 user nova-compute[71308]:     </serial>
Apr 14 19:03:32 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:03:32 user nova-compute[71308]:     <video>
Apr 14 19:03:32 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:03:32 user nova-compute[71308]:     </video>
Apr 14 19:03:32 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:03:32 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:03:32 user nova-compute[71308]:     </rng>
Apr 14 19:03:32 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:03:32 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:03:32 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:03:32 user nova-compute[71308]:     </memballoon>
Apr 14 19:03:32 user nova-compute[71308]:   </devices>
Apr 14 19:03:32 user nova-compute[71308]: </domain>
Apr 14 19:03:32 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1127447025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1127447025',id=38,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMie4jk+eKDDeaE+UlFjfMzkkdZn5tHrG2pp7P8c6d+PQZvYazMq2yTH5MI/VepSyomDJZZ/cTr9HacR1kMWge6kZ4qBZES1sp1DTJQpGt0DwmP8idMT1Qs9zoNJj5wRSQ==',key_name='tempest-keypair-1365704596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-e2gxcjgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=179270ef-7866-4ee7-af13-ec3ea5e7525a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG os_vif [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfef01e15-90, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfef01e15-90, col_values=(('external_ids', {'iface-id': 'fef01e15-9070-4b0b-ba18-0b9540774cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:25:ae', 'vm-uuid': '179270ef-7866-4ee7-af13-ec3ea5e7525a'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:32 user nova-compute[71308]: INFO os_vif [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90')
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:03:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] No VIF found with MAC fa:16:3e:f5:25:ae, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:03:33 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:03:33 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:03:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:33 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Deleted allocations for instance 56097076-1e63-41ba-8331-be8ede06c537
Apr 14 19:03:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-61741f81-c3e5-4b4f-9391-8644fb8e3ff8 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "56097076-1e63-41ba-8331-be8ede06c537" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.403s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-changed-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:33 user nova-compute[71308]: DEBUG nova.compute.manager [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Refreshing instance network info cache due to event network-changed-fef01e15-9070-4b0b-ba18-0b9540774cb9. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:03:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] Acquiring lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] Acquired lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:33 user nova-compute[71308]: DEBUG nova.network.neutron [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Refreshing network info cache for port fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG nova.network.neutron [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updated VIF entry in instance network info cache for port fef01e15-9070-4b0b-ba18-0b9540774cb9. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG nova.network.neutron [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating instance_info_cache with network_info: [{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a45e3476-27c1-42a1-ac55-cdf88530271e req-5fcff51e-2866-4234-856b-675260fbd8a9 service nova] Releasing lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:35 user nova-compute[71308]: WARNING nova.compute.manager [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state building and task_state spawning.
Apr 14 19:03:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:35 user nova-compute[71308]: WARNING nova.compute.manager [req-cf081496-09cd-404f-975f-e9004c5c3fa8 req-968e9607-4f60-41dd-98de-a945095645d6 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state building and task_state spawning.
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499016.8435977, 179270ef-7866-4ee7-af13-ec3ea5e7525a => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:03:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] VM Resumed (Lifecycle Event)
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:03:36 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance spawned successfully.
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:03:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499016.845848, 179270ef-7866-4ee7-af13-ec3ea5e7525a => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:03:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] VM Started (Lifecycle Event)
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:03:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:03:37 user nova-compute[71308]: INFO nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Took 8.30 seconds to spawn the instance on the hypervisor.
Apr 14 19:03:37 user nova-compute[71308]: DEBUG nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:37 user nova-compute[71308]: INFO nova.compute.manager [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Took 9.08 seconds to build instance.
Apr 14 19:03:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-562f6132-0008-4d3b-b203-40df22e818d5 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.194s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received event network-changed-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Refreshing instance network info cache due to event network-changed-48f196d4-dd0c-4499-8b7b-b0c4199cc059. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:03:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] Acquiring lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] Acquired lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:41 user nova-compute[71308]: DEBUG nova.network.neutron [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Refreshing network info cache for port 48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:03:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updated VIF entry in instance network info cache for port 48f196d4-dd0c-4499-8b7b-b0c4199cc059. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:03:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updating instance_info_cache with network_info: [{"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-8dfbfa37-f048-44df-b2a2-e65e8734f7ff req-de349b7e-6c08-4681-8edb-798ed42b44e9 service nova] Releasing lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Stashing vm_state: active {{(pid=71308) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'pci_requests' on Instance uuid d4a54fb1-bd66-42f5-9f8c-9fb40470f468 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:03:43 user nova-compute[71308]: INFO nova.compute.claims [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Claim successful on node user
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'resources' on Instance uuid d4a54fb1-bd66-42f5-9f8c-9fb40470f468 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'pci_devices' on Instance uuid d4a54fb1-bd66-42f5-9f8c-9fb40470f468 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:43 user nova-compute[71308]: INFO nova.compute.resource_tracker [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating resource usage from migration dffada2d-f093-4199-b1c7-9f2f343bc5f6
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-changed-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Refreshing instance network info cache due to event network-changed-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] Acquiring lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] Acquired lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.network.neutron [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Refreshing network info cache for port bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:03:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.477s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:43 user nova-compute[71308]: INFO nova.compute.manager [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Migrating
Apr 14 19:03:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updated VIF entry in instance network info cache for port bafdaca1-3fa1-4ec9-93ef-d357c8589ea2. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:03:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating instance_info_cache with network_info: [{"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-51e256a4-9d41-4701-b492-2dbe30157f33 req-90ddeeb8-2885-4a9f-844f-4240224f71eb service nova] Releasing lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:44 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:03:44 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499009.5930748, 56097076-1e63-41ba-8331-be8ede06c537 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:03:44 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 56097076-1e63-41ba-8331-be8ede06c537] VM Stopped (Lifecycle Event)
Apr 14 19:03:44 user nova-compute[71308]: DEBUG nova.compute.manager [None req-48a1588f-a4eb-40a8-82ab-630e5ca8ca3f None None] [instance: 56097076-1e63-41ba-8331-be8ede06c537] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating instance_info_cache with network_info: [{"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Starting migrate_disk_and_power_off {{(pid=71308) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-unplugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] No waiting events found dispatching network-vif-unplugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:45 user nova-compute[71308]: WARNING nova.compute.manager [req-7c3af91d-bfc9-4912-b845-68b7ee5425e3 req-db0666db-88e8-4b0a-9806-36acab52a3f5 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received unexpected event network-vif-unplugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance with vm_state active and task_state resize_migrating.
Apr 14 19:03:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:03:46 user nova-compute[71308]: INFO nova.compute.claims [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Claim successful on node user
Apr 14 19:03:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Instance destroyed successfully.
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1675664043',display_name='tempest-ServerActionsTestJSON-server-1675664043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1675664043',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:02:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-ghhedf08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=d4a54fb1-bd66-42f5-9f8c-9fb40470f468,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:9c:b6:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:9c:b6:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_vif [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbafdaca1-3f, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:03:46 user nova-compute[71308]: INFO os_vif [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f')
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFKupJlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:03:46 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211ebce-9974-4e0f-8c10-07e4f17006ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:03:46 user nova-compute[71308]: No targets found.
Apr 14 19:03:46 user nova-compute[71308]: iSNS:
Apr 14 19:03:46 user nova-compute[71308]: No targets found.
Apr 14 19:03:46 user nova-compute[71308]: STATIC:
Apr 14 19:03:46 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:03:46 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:46 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:46 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb
Apr 14 19:03:46 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:46 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:46 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 19:03:46 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:03:46 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:03:46 user nova-compute[71308]: FIRMWARE:
Apr 14 19:03:46 user nova-compute[71308]: No targets found.
Apr 14 19:03:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:03:46 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:03:46 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a01e99-835e-44ef-a63f-6fa60b50c554]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2accc28-b4c3-43f5-878d-69b94781101a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:46 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:46 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:46 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:46 user nova-compute[71308]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227a90ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39'): ({'sdg'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Removing single pathed devices sdg {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f7376a-7f0a-4253-ad08-8d9c8fe7536c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[473189d5-0583-46c6-a693-98b0d76a6a06]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flushing IO for device /dev/sdg {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[532b87be-70cb-4151-9c3a-716cb17061b3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[159a6871-0cc4-4533-8788-1c7110aaca97]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] SCSI volumes sdg have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fe0b1993', '/dev/disk/by-id/scsi-1SCST_BIOfe0b1993-4cc4fc0626a7c555', '/dev/disk/by-id/scsi-23463633466633036') {{(pid=81547) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e362c4c-5c1e-46eb-91f1-7eac626ac1a7]: (4, None) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece48da-2844-4508-be65-765e208aa96f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f50e29-6f1f-4b3c-b4df-3f9dc9326b28]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260]
Apr 14 19:03:46 user nova-compute[71308]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260] successful.
Apr 14 19:03:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d7b12c-d303-453f-a2d0-9da2dc9d5329]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== disconnect_volume: return (420ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:03:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.policy [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10cf3683f78d4724bb734e5280e8736b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81575e6ed9bc41d2ad2ac1ad0fbd253d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:03:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Creating image(s)
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "/opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "/opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk 1073741824" returned: 0 in 0.063s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Cannot resize image /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'migration_context' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Ensure instance console log exists: /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received event network-changed-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Refreshing instance network info cache due to event network-changed-08acb0d5-2432-42fe-a372-78f11a73ed56. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] Acquiring lock "refresh_cache-15ebad56-cad0-4ab3-853f-72e3a3d2117f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] Acquired lock "refresh_cache-15ebad56-cad0-4ab3-853f-72e3a3d2117f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG nova.network.neutron [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Refreshing network info cache for port 08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:03:47 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Successfully created port: f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Port bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 binding to destination host user is already ACTIVE {{(pid=71308) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] No waiting events found dispatching network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:48 user nova-compute[71308]: WARNING nova.compute.manager [req-c4decb14-8aa5-4620-8532-0ce2f1d58772 req-50ae4344-f12c-427a-bab8-9ab96c59b3ba service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received unexpected event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance with vm_state active and task_state resize_migrating.
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG nova.network.neutron [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Updated VIF entry in instance network info cache for port 08acb0d5-2432-42fe-a372-78f11a73ed56. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG nova.network.neutron [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Updating instance_info_cache with network_info: [{"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a92ac941-fffc-4076-940c-fd1bc0f58973 req-d8e35843-03ea-42f1-8cd1-69fe51613aa6 service nova] Releasing lock "refresh_cache-15ebad56-cad0-4ab3-853f-72e3a3d2117f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating instance_info_cache with network_info: [{"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:48 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Successfully updated port: f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquired lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received event network-changed-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Refreshing instance network info cache due to event network-changed-f22a5e1e-5aed-419f-aa06-308984681fbc. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] Acquiring lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG os_brick.utils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97dea69-e088-4462-9fc6-599208a35592]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe07719-e710-41a3-87af-15d7ad40bded]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5395c9d-f3bf-4367-80d4-e1bcdcf43c60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabdf617-17b6-4f50-8a69-f96c9c600f74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:03:49 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a7a2d3-ef7f-4b3b-b3c4-0285ed37257d]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG os_brick.utils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating instance_info_cache with network_info: [{"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Releasing lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Instance network_info: |[{"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] Acquired lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.neutron [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Refreshing network info cache for port f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Start _get_guest_xml network_info=[{"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:03:49 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:03:49 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1761427350',display_name='tempest-SnapshotDataIntegrityTests-server-1761427350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1761427350',id=39,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrqSX4Dn4cbtD2ThR27vz4fxPv5iy/c0ZdVOmEv91SBknzw38dyQkj7dyYpk0+xiBPENn2s6fqiXGS4lq+2CMLc45iU3VwfBmaBTRKP0e+5nHYYYSr3CL2L7A6SUZfiQg==',key_name='tempest-SnapshotDataIntegrityTests-1211605812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81575e6ed9bc41d2ad2ac1ad0fbd253d',ramdisk_id='',reservation_id='r-0mzbzz03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-593938196',owner_user_name='tempest-SnapshotDataIntegrityTests-593938196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:03:47Z,user_data=None,user_id='10cf3683f78d4724bb734e5280e8736b',uuid=a9379580-fd2f-4468-9ed3-7109735195be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Converting VIF {"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:62:f6,bridge_name='br-int',has_traffic_filtering=True,id=f22a5e1e-5aed-419f-aa06-308984681fbc,network=Network(912a39a0-80e1-492a-a05a-8523964167a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22a5e1e-5a') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'pci_devices' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:03:49 user nova-compute[71308]:   <uuid>a9379580-fd2f-4468-9ed3-7109735195be</uuid>
Apr 14 19:03:49 user nova-compute[71308]:   <name>instance-00000027</name>
Apr 14 19:03:49 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:03:49 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:03:49 user nova-compute[71308]:   <metadata>
Apr 14 19:03:49 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:03:49 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:03:49 user nova-compute[71308]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1761427350</nova:name>
Apr 14 19:03:49 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:03:49</nova:creationTime>
Apr 14 19:03:49 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:03:49 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:03:49 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:03:49 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:03:49 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:03:49 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:03:49 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:03:49 user nova-compute[71308]:       <nova:owner>
Apr 14 19:03:49 user nova-compute[71308]:         <nova:user uuid="10cf3683f78d4724bb734e5280e8736b">tempest-SnapshotDataIntegrityTests-593938196-project-member</nova:user>
Apr 14 19:03:49 user nova-compute[71308]:         <nova:project uuid="81575e6ed9bc41d2ad2ac1ad0fbd253d">tempest-SnapshotDataIntegrityTests-593938196</nova:project>
Apr 14 19:03:49 user nova-compute[71308]:       </nova:owner>
Apr 14 19:03:49 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 19:03:49 user nova-compute[71308]:       <nova:ports>
Apr 14 19:03:49 user nova-compute[71308]:         <nova:port uuid="f22a5e1e-5aed-419f-aa06-308984681fbc">
Apr 14 19:03:49 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 19:03:49 user nova-compute[71308]:         </nova:port>
Apr 14 19:03:49 user nova-compute[71308]:       </nova:ports>
Apr 14 19:03:49 user nova-compute[71308]:     </nova:instance>
Apr 14 19:03:49 user nova-compute[71308]:   </metadata>
Apr 14 19:03:49 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:03:49 user nova-compute[71308]:     <system>
Apr 14 19:03:49 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:03:49 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:03:49 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:03:49 user nova-compute[71308]:       <entry name="serial">a9379580-fd2f-4468-9ed3-7109735195be</entry>
Apr 14 19:03:49 user nova-compute[71308]:       <entry name="uuid">a9379580-fd2f-4468-9ed3-7109735195be</entry>
Apr 14 19:03:49 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:03:49 user nova-compute[71308]:     </system>
Apr 14 19:03:49 user nova-compute[71308]:   </sysinfo>
Apr 14 19:03:49 user nova-compute[71308]:   <os>
Apr 14 19:03:49 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:03:49 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:03:49 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:03:49 user nova-compute[71308]:   </os>
Apr 14 19:03:49 user nova-compute[71308]:   <features>
Apr 14 19:03:49 user nova-compute[71308]:     <acpi/>
Apr 14 19:03:49 user nova-compute[71308]:     <apic/>
Apr 14 19:03:49 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:03:49 user nova-compute[71308]:   </features>
Apr 14 19:03:49 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:03:49 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:03:49 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:03:49 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:03:49 user nova-compute[71308]:   </clock>
Apr 14 19:03:49 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:03:49 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:03:49 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:03:49 user nova-compute[71308]:   </cpu>
Apr 14 19:03:49 user nova-compute[71308]:   <devices>
Apr 14 19:03:49 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:03:49 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:03:49 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk"/>
Apr 14 19:03:49 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:03:49 user nova-compute[71308]:     </disk>
Apr 14 19:03:49 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:03:49 user nova-compute[71308]:       <mac address="fa:16:3e:9f:62:f6"/>
Apr 14 19:03:49 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:03:49 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:03:49 user nova-compute[71308]:       <target dev="tapf22a5e1e-5a"/>
Apr 14 19:03:49 user nova-compute[71308]:     </interface>
Apr 14 19:03:49 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:03:49 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/console.log" append="off"/>
Apr 14 19:03:49 user nova-compute[71308]:     </serial>
Apr 14 19:03:49 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:03:49 user nova-compute[71308]:     <video>
Apr 14 19:03:49 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:03:49 user nova-compute[71308]:     </video>
Apr 14 19:03:49 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:03:49 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:03:49 user nova-compute[71308]:     </rng>
Apr 14 19:03:49 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:03:49 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:03:49 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:03:49 user nova-compute[71308]:     </memballoon>
Apr 14 19:03:49 user nova-compute[71308]:   </devices>
Apr 14 19:03:49 user nova-compute[71308]: </domain>
Apr 14 19:03:49 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1761427350',display_name='tempest-SnapshotDataIntegrityTests-server-1761427350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1761427350',id=39,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrqSX4Dn4cbtD2ThR27vz4fxPv5iy/c0ZdVOmEv91SBknzw38dyQkj7dyYpk0+xiBPENn2s6fqiXGS4lq+2CMLc45iU3VwfBmaBTRKP0e+5nHYYYSr3CL2L7A6SUZfiQg==',key_name='tempest-SnapshotDataIntegrityTests-1211605812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81575e6ed9bc41d2ad2ac1ad0fbd253d',ramdisk_id='',reservation_id='r-0mzbzz03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-593938196',owner_user_name='tempest-SnapshotDataIntegrityTests-593938196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:03:47Z,user_data=None,user_id='10cf3683f78d4724bb734e5280e8736b',uuid=a9379580-fd2f-4468-9ed3-7109735195be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Converting VIF {"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:62:f6,bridge_name='br-int',has_traffic_filtering=True,id=f22a5e1e-5aed-419f-aa06-308984681fbc,network=Network(912a39a0-80e1-492a-a05a-8523964167a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22a5e1e-5a') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG os_vif [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:62:f6,bridge_name='br-int',has_traffic_filtering=True,id=f22a5e1e-5aed-419f-aa06-308984681fbc,network=Network(912a39a0-80e1-492a-a05a-8523964167a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22a5e1e-5a') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf22a5e1e-5a, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf22a5e1e-5a, col_values=(('external_ids', {'iface-id': 'f22a5e1e-5aed-419f-aa06-308984681fbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:62:f6', 'vm-uuid': 'a9379580-fd2f-4468-9ed3-7109735195be'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:49 user nova-compute[71308]: INFO os_vif [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:62:f6,bridge_name='br-int',has_traffic_filtering=True,id=f22a5e1e-5aed-419f-aa06-308984681fbc,network=Network(912a39a0-80e1-492a-a05a-8523964167a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22a5e1e-5a')
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No VIF found with MAC fa:16:3e:9f:62:f6, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.neutron [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updated VIF entry in instance network info cache for port f22a5e1e-5aed-419f-aa06-308984681fbc. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG nova.network.neutron [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating instance_info_cache with network_info: [{"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:03:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-13103b23-e4ca-4ade-b5b9-964f241af341 req-55f3a5fa-bb74-4fe0-8387-49fdac0a4646 service nova] Releasing lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:50 user nova-compute[71308]: INFO nova.compute.manager [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Attaching volume afa35698-f508-4611-b895-bc408a4fb317 to /dev/vdb
Apr 14 19:03:50 user nova-compute[71308]: DEBUG os_brick.utils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbc9901-0053-499f-b8a9-0322044fcfd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1be56e-1fc4-4794-9b23-24f46272ad05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[816aea31-6050-41ef-ad6e-831d4335a877]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd45025-d9de-49fc-aada-22683e0f5690]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:03:50 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:03:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbfb7b3-073e-44fc-b81a-1a6362a00fb3]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG os_brick.utils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Updating existing volume attachment record: 9aad5a77-6e72-41f7-80dd-97ab07ad8162 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received event network-vif-plugged-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] No waiting events found dispatching network-vif-plugged-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:51 user nova-compute[71308]: WARNING nova.compute.manager [req-e495d845-d8a4-4602-b393-39566bb9f6ca req-ad5abe5e-f8b5-4ff1-9dc7-cc3bbd67bccf service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received unexpected event network-vif-plugged-f22a5e1e-5aed-419f-aa06-308984681fbc for instance with vm_state building and task_state spawning.
Apr 14 19:03:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499033.143317, a9379580-fd2f-4468-9ed3-7109735195be => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:03:53 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] VM Resumed (Lifecycle Event)
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:03:53 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Instance spawned successfully.
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:03:53 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499033.1437836, a9379580-fd2f-4468-9ed3-7109735195be => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:03:53 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] VM Started (Lifecycle Event)
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received event network-vif-plugged-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] No waiting events found dispatching network-vif-plugged-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:53 user nova-compute[71308]: WARNING nova.compute.manager [req-b1f2fa14-d4ca-4087-8c0a-7542a20f60ae req-ad200284-af0b-45b9-8d19-464e83648db5 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received unexpected event network-vif-plugged-f22a5e1e-5aed-419f-aa06-308984681fbc for instance with vm_state building and task_state spawning.
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:03:53 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:03:53 user nova-compute[71308]: INFO nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Took 6.29 seconds to spawn the instance on the hypervisor.
Apr 14 19:03:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:53 user nova-compute[71308]: INFO nova.compute.manager [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Took 7.34 seconds to build instance.
Apr 14 19:03:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d965347a-b2c8-49ca-ad47-247664b7be73 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.441s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Starting finish_migration {{(pid=71308) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Instance directory exists: not creating {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 19:03:54 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Creating image(s)
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Ensure instance console log exists: /opt/stack/data/nova/instances/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Start _get_guest_xml network_info=[{"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:9c:b6:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'attachment_id': '844a9416-b662-41c3-892b-a7ed4b3fcf40', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFKupJlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd4a54fb1-bd66-42f5-9f8c-9fb40470f468', 'attached_at': '2023-04-14T19:03:54.000000', 'detached_at': '', 'volume_id': '4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'serial': '4441ca6a-4e8c-45c6-9669-8db66ae94a39'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:03:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:03:54 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:31Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4a54fb1-bd66-42f5-9f8c-9fb40470f468 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFKupJlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:03:54 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:03:54 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:03:54 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[727d0cf7-8a3d-4288-aaef-ea8026b4a236]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:03:54 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa3ee7a-50d3-4adc-bdeb-fcafdc5306ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39] added
Apr 14 19:03:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf9f058-751b-437a-9c01-57e71b93d12b]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ffa8e-5cdf-4f09-8ba2-bdd5cebf7bcb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFKupJlD {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFKupJlD" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b3c974-e64f-493d-9cb9-a63fe91494e0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HFKupJlD'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[14766719-8c25-49f1-b449-99910b65e915]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4ce30e-c5bc-495e-92b4-a8cdda5aba1f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:54 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:54 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c3f9ca-b40d-4c43-beb3-df9c7cd80d56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260]
Apr 14 19:03:54 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260] successful.
Apr 14 19:03:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8d1427-c789-43fd-8ab9-e972ba266ca0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d26af77-d92d-4ce9-af16-660bdca912e2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:54 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:54 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:54 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:54 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:54 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2872355e-d698-401b-b196-e079bb1e8378]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFKupJlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:03:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23463633466633036', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463633466633036', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1675664043',display_name='tempest-ServerActionsTestJSON-server-1675664043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1675664043',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:02:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-ghhedf08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=d4a54fb1-bd66-42f5-9f8c-9fb40470f468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:9c:b6:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:9c:b6:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:03:55 user nova-compute[71308]:   <uuid>d4a54fb1-bd66-42f5-9f8c-9fb40470f468</uuid>
Apr 14 19:03:55 user nova-compute[71308]:   <name>instance-00000024</name>
Apr 14 19:03:55 user nova-compute[71308]:   <memory>196608</memory>
Apr 14 19:03:55 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:03:55 user nova-compute[71308]:   <metadata>
Apr 14 19:03:55 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:03:55 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:03:55 user nova-compute[71308]:       <nova:name>tempest-ServerActionsTestJSON-server-1675664043</nova:name>
Apr 14 19:03:55 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:03:54</nova:creationTime>
Apr 14 19:03:55 user nova-compute[71308]:       <nova:flavor name="m1.micro">
Apr 14 19:03:55 user nova-compute[71308]:         <nova:memory>192</nova:memory>
Apr 14 19:03:55 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:03:55 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:03:55 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:03:55 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:03:55 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:03:55 user nova-compute[71308]:       <nova:owner>
Apr 14 19:03:55 user nova-compute[71308]:         <nova:user uuid="55fa4abe2fdd48cb91f39bf8156a7793">tempest-ServerActionsTestJSON-2112054326-project-member</nova:user>
Apr 14 19:03:55 user nova-compute[71308]:         <nova:project uuid="f028a79640b848228dc6e654a0eef49b">tempest-ServerActionsTestJSON-2112054326</nova:project>
Apr 14 19:03:55 user nova-compute[71308]:       </nova:owner>
Apr 14 19:03:55 user nova-compute[71308]:       <nova:ports>
Apr 14 19:03:55 user nova-compute[71308]:         <nova:port uuid="bafdaca1-3fa1-4ec9-93ef-d357c8589ea2">
Apr 14 19:03:55 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 19:03:55 user nova-compute[71308]:         </nova:port>
Apr 14 19:03:55 user nova-compute[71308]:       </nova:ports>
Apr 14 19:03:55 user nova-compute[71308]:     </nova:instance>
Apr 14 19:03:55 user nova-compute[71308]:   </metadata>
Apr 14 19:03:55 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:03:55 user nova-compute[71308]:     <system>
Apr 14 19:03:55 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:03:55 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:03:55 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:03:55 user nova-compute[71308]:       <entry name="serial">d4a54fb1-bd66-42f5-9f8c-9fb40470f468</entry>
Apr 14 19:03:55 user nova-compute[71308]:       <entry name="uuid">d4a54fb1-bd66-42f5-9f8c-9fb40470f468</entry>
Apr 14 19:03:55 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:03:55 user nova-compute[71308]:     </system>
Apr 14 19:03:55 user nova-compute[71308]:   </sysinfo>
Apr 14 19:03:55 user nova-compute[71308]:   <os>
Apr 14 19:03:55 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:03:55 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:03:55 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:03:55 user nova-compute[71308]:   </os>
Apr 14 19:03:55 user nova-compute[71308]:   <features>
Apr 14 19:03:55 user nova-compute[71308]:     <acpi/>
Apr 14 19:03:55 user nova-compute[71308]:     <apic/>
Apr 14 19:03:55 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:03:55 user nova-compute[71308]:   </features>
Apr 14 19:03:55 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:03:55 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:03:55 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:03:55 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:03:55 user nova-compute[71308]:   </clock>
Apr 14 19:03:55 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:03:55 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:03:55 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:03:55 user nova-compute[71308]:   </cpu>
Apr 14 19:03:55 user nova-compute[71308]:   <devices>
Apr 14 19:03:55 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 19:03:55 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:03:55 user nova-compute[71308]:       <source dev="/dev/sdb"/>
Apr 14 19:03:55 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:03:55 user nova-compute[71308]:       <serial>4441ca6a-4e8c-45c6-9669-8db66ae94a39</serial>
Apr 14 19:03:55 user nova-compute[71308]:     </disk>
Apr 14 19:03:55 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:03:55 user nova-compute[71308]:       <mac address="fa:16:3e:9c:b6:c8"/>
Apr 14 19:03:55 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:03:55 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:03:55 user nova-compute[71308]:       <target dev="tapbafdaca1-3f"/>
Apr 14 19:03:55 user nova-compute[71308]:     </interface>
Apr 14 19:03:55 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:03:55 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/d4a54fb1-bd66-42f5-9f8c-9fb40470f468/console.log" append="off"/>
Apr 14 19:03:55 user nova-compute[71308]:     </serial>
Apr 14 19:03:55 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:03:55 user nova-compute[71308]:     <video>
Apr 14 19:03:55 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:03:55 user nova-compute[71308]:     </video>
Apr 14 19:03:55 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:03:55 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:03:55 user nova-compute[71308]:     </rng>
Apr 14 19:03:55 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:03:55 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:03:55 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:03:55 user nova-compute[71308]:     </memballoon>
Apr 14 19:03:55 user nova-compute[71308]:   </devices>
Apr 14 19:03:55 user nova-compute[71308]: </domain>
Apr 14 19:03:55 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1675664043',display_name='tempest-ServerActionsTestJSON-server-1675664043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1675664043',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:02:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-ghhedf08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:03:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=d4a54fb1-bd66-42f5-9f8c-9fb40470f468,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:9c:b6:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1194537843-network", "vif_mac": "fa:16:3e:9c:b6:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_vif [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbafdaca1-3f, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbafdaca1-3f, col_values=(('external_ids', {'iface-id': 'bafdaca1-3fa1-4ec9-93ef-d357c8589ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b6:c8', 'vm-uuid': 'd4a54fb1-bd66-42f5-9f8c-9fb40470f468'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFfRHDAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:03:55 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:03:55 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:03:55 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:03:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:55 user nova-compute[71308]: INFO os_vif [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f')
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cfdc27-4830-4a0a-945a-b34ccd21a8ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:03:55 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[35429b8e-6d0d-4be9-9ff8-fb7c0c8d1153]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317] added
Apr 14 19:03:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ffb839-a532-40a1-a32b-efe6c11cd71b]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2eb8a7-14b6-45b5-8873-bca0cc1bc082]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] No VIF found with MAC fa:16:3e:9c:b6:c8, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WFfRHDAn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WFfRHDAn" returned: 0 in 0.069s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d9446d-a558-4155-b839-97a0998d9957]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WFfRHDAn'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c341c178-3e14-41a9-a2c9-108c214da0d6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5267c3-954a-4ba4-b846-73d5bec2f79d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e49733-ce89-42ea-a606-11e559cd7747]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317, portal: 172.16.0.220,3260]
Apr 14 19:03:55 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317, portal: 172.16.0.220,3260] successful.
Apr 14 19:03:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c394050d-8373-4a0b-ae6a-2d23b6e26168]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd7e840-8713-4f7a-bc8a-e87810cc61b4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)
Apr 14 19:03:55 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86efdae-7a10-4e27-aaf1-b337eedc19a9]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:03:55 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFfRHDAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:03:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:03:56 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23537646131373865', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:03:56 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537646131373865', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:03:56 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 19:03:57 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:03:57 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 19:03:57 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:03:57 user nova-compute[71308]:   <serial>afa35698-f508-4611-b895-bc408a4fb317</serial>
Apr 14 19:03:57 user nova-compute[71308]: </disk>
Apr 14 19:03:57 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] No waiting events found dispatching network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:57 user nova-compute[71308]: WARNING nova.compute.manager [req-94237bf8-2c83-4b0f-b7a2-2c27d77c7f8a req-dbf77f01-0862-4d91-a7c2-d79aa46a10a4 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received unexpected event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance with vm_state active and task_state resize_finish.
Apr 14 19:03:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No VIF found with MAC fa:16:3e:f1:93:45, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:03:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7d577067-a7b7-4fb7-a55a-a1af1d112b03 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.199s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:58 user nova-compute[71308]: INFO nova.compute.manager [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Terminating instance
Apr 14 19:03:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:03:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received event network-vif-unplugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] Acquiring lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] No waiting events found dispatching network-vif-unplugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-4d581c9a-7756-4b19-9928-0ccbac5c4f62 req-eca8600e-01a3-4893-9861-d4732030cff9 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received event network-vif-unplugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] No waiting events found dispatching network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:03:59 user nova-compute[71308]: WARNING nova.compute.manager [req-ecdaf521-21a0-4e05-88a3-0989225c7f76 req-6d75b424-ba6c-4c01-af18-5cb038dcdbf2 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received unexpected event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance with vm_state active and task_state resize_finish.
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.host [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Removed pending event for d4a54fb1-bd66-42f5-9f8c-9fb40470f468 due to event {{(pid=71308) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499039.4549909, d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:03:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] VM Resumed (Lifecycle Event)
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:03:59 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Instance running successfully.
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Failed to set time: agent not configured {{(pid=71308) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f6b91a61-613b-49f4-b2d2-106069020895 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] finish_migration finished successfully. {{(pid=71308) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:03:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499039.459004, d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:03:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] VM Started (Lifecycle Event)
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:03:59 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Instance destroyed successfully.
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.objects.instance [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'resources' on Instance uuid 6e79e2cb-54c5-487e-b852-49303ee3e3cc {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:03:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-758523543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-758523543',id=25,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-kda3ngt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:56:32Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=6e79e2cb-54c5-487e-b852-49303ee3e3cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "address": "fa:16:3e:18:6f:90", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf3f209-95", "ovs_interfaceid": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "address": "fa:16:3e:18:6f:90", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdf3f209-95", "ovs_interfaceid": "fdf3f209-95c6-4369-a6b6-13c2aed1371b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=fdf3f209-95c6-4369-a6b6-13c2aed1371b,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf3f209-95') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG os_vif [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=fdf3f209-95c6-4369-a6b6-13c2aed1371b,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf3f209-95') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdf3f209-95, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:03:59 user nova-compute[71308]: INFO os_vif [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:6f:90,bridge_name='br-int',has_traffic_filtering=True,id=fdf3f209-95c6-4369-a6b6-13c2aed1371b,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdf3f209-95')
Apr 14 19:03:59 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Deleting instance files /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc_del
Apr 14 19:03:59 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Deletion of /opt/stack/data/nova/instances/6e79e2cb-54c5-487e-b852-49303ee3e3cc_del complete
Apr 14 19:03:59 user nova-compute[71308]: INFO nova.compute.manager [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 19:03:59 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:03:59 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:04:00 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:04:00 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Took 0.54 seconds to deallocate network for instance.
Apr 14 19:04:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:00 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:04:00 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:04:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:00 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Deleted allocations for instance 6e79e2cb-54c5-487e-b852-49303ee3e3cc
Apr 14 19:04:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-6b7ccb2e-c9dd-4cf1-9652-352218d859d9 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:00 user nova-compute[71308]: DEBUG nova.objects.instance [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received event network-vif-plugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] Acquiring lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] Lock "6e79e2cb-54c5-487e-b852-49303ee3e3cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] No waiting events found dispatching network-vif-plugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:04:01 user nova-compute[71308]: WARNING nova.compute.manager [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received unexpected event network-vif-plugged-fdf3f209-95c6-4369-a6b6-13c2aed1371b for instance with vm_state deleted and task_state None.
Apr 14 19:04:01 user nova-compute[71308]: DEBUG nova.compute.manager [req-b5675e77-8831-4c90-9369-e5cc49d603ab req-f61df7e8-b59a-4fff-9246-65d079620834 service nova] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Received event network-vif-deleted-fdf3f209-95c6-4369-a6b6-13c2aed1371b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:01 user nova-compute[71308]: INFO nova.compute.manager [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Attaching volume b0ab062d-a039-4893-943e-25ed1de95160 to /dev/vdc
Apr 14 19:04:01 user nova-compute[71308]: DEBUG os_brick.utils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f33095d-eac2-4246-bec2-755c2fa240dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d70b93e-b73d-4f67-9267-c1f751741026]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdd3f45-d01e-44e8-ad0c-e5555053309a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ed423-12d1-46a0-8132-28f5ee005b7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:04:01 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:04:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a91902-b784-4160-9709-c74489727b08]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG os_brick.utils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:04:01 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Updating existing volume attachment record: 89f0cec5-8086-4694-982f-d0294ffb7917 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:04:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:04 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBtjNYoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:04:06 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:04:06 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:04:06 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa37890e-97bf-461b-8164-5df4797d76b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:04:06 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb78d30a-ab1d-42f3-b268-3944bc78aebe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160] added
Apr 14 19:04:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6ab846-26cb-4717-99bd-0b7489e68b4b]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8208d5a2-9d6c-47d9-903e-f1509dbb767a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBtjNYoA {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XBtjNYoA" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5f476e-f9e6-4ea7-a928-4f519dbe1b9f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XBtjNYoA'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e43a05-1d11-467f-b1a4-18dc56bfd7b9]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[21226cab-d243-42e0-ab7d-9910e5f77e44]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f064237-d106-4c45-beea-b735bb1549b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160, portal: 172.16.0.220,3260]
Apr 14 19:04:06 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160, portal: 172.16.0.220,3260] successful.
Apr 14 19:04:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6fa54b-041c-4e80-a46a-645075b06485]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f02c4bc-ca76-4cd8-a90d-aab99621d9f5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 (non-flash)
Apr 14 19:04:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bbaa2a-203a-4f94-a694-5a277da03987]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBtjNYoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23265333136386463', 'path': '/dev/sde'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265333136386463', 'path': '/dev/sde'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG nova.objects.instance [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 19:04:07 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:04:07 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 19:04:07 user nova-compute[71308]:   <target dev="vdc" bus="virtio"/>
Apr 14 19:04:07 user nova-compute[71308]:   <serial>b0ab062d-a039-4893-943e-25ed1de95160</serial>
Apr 14 19:04:07 user nova-compute[71308]: </disk>
Apr 14 19:04:07 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:04:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] No VIF found with MAC fa:16:3e:f1:93:45, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:04:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-de33adcf-d93a-4e7f-af41-97c266a1b882 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.922s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:09 user nova-compute[71308]: INFO nova.compute.manager [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Detaching volume afa35698-f508-4611-b895-bc408a4fb317
Apr 14 19:04:09 user nova-compute[71308]: INFO nova.virt.block_device [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Attempting to driver detach volume afa35698-f508-4611-b895-bc408a4fb317 from mountpoint /dev/vdb
Apr 14 19:04:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Attempting to detach device vdb from instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:04:09 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:04:09 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 19:04:09 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:04:09 user nova-compute[71308]:   <serial>afa35698-f508-4611-b895-bc408a4fb317</serial>
Apr 14 19:04:09 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:04:09 user nova-compute[71308]: </disk>
Apr 14 19:04:09 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:04:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully detached device vdb from instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f from the persistent domain config.
Apr 14 19:04:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:04:09 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:04:09 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 19:04:09 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:04:09 user nova-compute[71308]:   <serial>afa35698-f508-4611-b895-bc408a4fb317</serial>
Apr 14 19:04:09 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:04:09 user nova-compute[71308]: </disk>
Apr 14 19:04:09 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681499049.7049968, 15ebad56-cad0-4ab3-853f-72e3a3d2117f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 19:04:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully detached device vdb from instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f from the live domain config.
Apr 14 19:04:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WFfRHDAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:04:09 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[738915e3-90b1-455e-abce-7850720897da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:04:09 user nova-compute[71308]: No targets found.
Apr 14 19:04:09 user nova-compute[71308]: iSNS:
Apr 14 19:04:09 user nova-compute[71308]: No targets found.
Apr 14 19:04:09 user nova-compute[71308]: STATIC:
Apr 14 19:04:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:04:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb
Apr 14 19:04:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160
Apr 14 19:04:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317
Apr 14 19:04:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 19:04:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:09 user nova-compute[71308]: FIRMWARE:
Apr 14 19:04:09 user nova-compute[71308]: No targets found.
Apr 14 19:04:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:04:09 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:04:09 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eb8db5-89b2-4387-98e8-7077c3f97d92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d601000-cad2-4303-9e33-1ec33d6b49a3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:09 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:09 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:09 user nova-compute[71308]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)
Apr 14 19:04:09 user nova-compute[71308]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 (non-flash)
Apr 14 19:04:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:09 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:09 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:09 user nova-compute[71308]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 (non-flash)
Apr 14 19:04:09 user nova-compute[71308]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 (non-flash)
Apr 14 19:04:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22306ab760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a78be0-3008-4315-bcb9-51b556ee2a1d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[024bcf9c-f6c0-4710-bbf5-d8d40c8584c5]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439e898-6ea7-47ae-b60a-285f265ba967]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6735853c-0115-42a8-b9ce-236732614aa5]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0f7bef-2d68-4de3-9645-1c9680f4601b]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc6556b-5f87-4054-820a-f928ba5abb58]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317, portal: 172.16.0.220,3260]
Apr 14 19:04:10 user nova-compute[71308]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317, portal: 172.16.0.220,3260] successful.
Apr 14 19:04:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa35698-f508-4611-b895-bc408a4fb317 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf8d1a5-045f-417c-bf4a-bc5a11a0ccfa]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== disconnect_volume: return (334ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0c47894-1343-4900-911d-f69a08bc62f1 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.816s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:11 user nova-compute[71308]: INFO nova.compute.manager [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Detaching volume b0ab062d-a039-4893-943e-25ed1de95160
Apr 14 19:04:11 user nova-compute[71308]: INFO nova.virt.block_device [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Attempting to driver detach volume b0ab062d-a039-4893-943e-25ed1de95160 from mountpoint /dev/vdc
Apr 14 19:04:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Attempting to detach device vdc from instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 19:04:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:04:11 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:04:11 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 19:04:11 user nova-compute[71308]:   <target dev="vdc" bus="virtio"/>
Apr 14 19:04:11 user nova-compute[71308]:   <serial>b0ab062d-a039-4893-943e-25ed1de95160</serial>
Apr 14 19:04:11 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 19:04:11 user nova-compute[71308]: </disk>
Apr 14 19:04:11 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:04:11 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully detached device vdc from instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f from the persistent domain config.
Apr 14 19:04:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 19:04:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:04:11 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:04:11 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 19:04:11 user nova-compute[71308]:   <target dev="vdc" bus="virtio"/>
Apr 14 19:04:11 user nova-compute[71308]:   <serial>b0ab062d-a039-4893-943e-25ed1de95160</serial>
Apr 14 19:04:11 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 19:04:11 user nova-compute[71308]: </disk>
Apr 14 19:04:11 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681499052.1202235, 15ebad56-cad0-4ab3-853f-72e3a3d2117f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 19:04:12 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully detached device vdc from instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f from the live domain config.
Apr 14 19:04:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XBtjNYoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:04:12 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe761d51-d820-4ef7-ab92-7d0eaf6a0977]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:04:12 user nova-compute[71308]: No targets found.
Apr 14 19:04:12 user nova-compute[71308]: iSNS:
Apr 14 19:04:12 user nova-compute[71308]: No targets found.
Apr 14 19:04:12 user nova-compute[71308]: STATIC:
Apr 14 19:04:12 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:04:12 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:12 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:12 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb
Apr 14 19:04:12 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:12 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:12 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160
Apr 14 19:04:12 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:12 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:12 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 19:04:12 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:12 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:12 user nova-compute[71308]: FIRMWARE:
Apr 14 19:04:12 user nova-compute[71308]: No targets found.
Apr 14 19:04:12 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:04:12 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:04:12 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6603521-da7b-494c-9346-61eb36278381]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f345b25-a235-4682-8e44-f23b89986824]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:12 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:12 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:12 user nova-compute[71308]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 (non-flash)
Apr 14 19:04:12 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:12 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:12 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:12 user nova-compute[71308]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 (non-flash)
Apr 14 19:04:12 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2278710b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160'): ({'sde'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Removing single pathed devices sde {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14d4b1b-f4e7-4bc5-b0ac-924129cfb3e0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ec431-f881-4b65-9fc5-934ac8ccc14f]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Flushing IO for device /dev/sde {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[45aaad7c-4648-4876-9bee-719a5bf6f8d0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f54bbf-0fe0-4723-a249-46ffc2a28498]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84af573-6adc-4c44-a30d-cf57a88144f2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d31652-1829-4754-8645-2f65a0a216df]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160, portal: 172.16.0.220,3260]
Apr 14 19:04:12 user nova-compute[71308]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160, portal: 172.16.0.220,3260] successful.
Apr 14 19:04:12 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0ab062d-a039-4893-943e-25ed1de95160 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db26557-757e-435d-a22a-ed84a6207648]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] <== disconnect_volume: return (336ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:04:13 user nova-compute[71308]: DEBUG nova.objects.instance [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'flavor' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:04:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-81e7f40f-5308-46b3-bbb5-196915e6d9d9 tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.882s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:14 user nova-compute[71308]: INFO nova.compute.manager [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Terminating instance
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received event network-vif-unplugged-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] No waiting events found dispatching network-vif-unplugged-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.compute.manager [req-85944ee6-c03e-48c2-b0d5-4068c0e2e44a req-fc76a084-82a8-4c3a-91dc-359ca5a2c1e5 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received event network-vif-unplugged-08acb0d5-2432-42fe-a372-78f11a73ed56 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499039.5786922, 6e79e2cb-54c5-487e-b852-49303ee3e3cc => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:04:14 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] VM Stopped (Lifecycle Event)
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4afca6ef-9fd2-45cc-b284-1e8547573d42 None None] [instance: 6e79e2cb-54c5-487e-b852-49303ee3e3cc] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Instance destroyed successfully.
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.objects.instance [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lazy-loading 'resources' on Instance uuid 15ebad56-cad0-4ab3-853f-72e3a3d2117f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2038797611',display_name='tempest-AttachVolumeTestJSON-server-2038797611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2038797611',id=37,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8HTfZpcc8mgXo4AFnwhG4K4/O/z3QrzgEBaxKd3TyzfRmFooJLVotAQ5vypXEppo8BUy020ij2j7iBnMQIFDslNGH0Kg+6YUYeTL3M4R8QHGfv3cvG6Xoj82DMjalKAA==',key_name='tempest-keypair-1109149281',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:02:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edf25bcc0dea4d3eb1284e8995eb3466',ramdisk_id='',reservation_id='r-c8djfpah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1126291015',owner_user_name='tempest-AttachVolumeTestJSON-1126291015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f90c8f23e3b42a98fdb9261db65f547',uuid=15ebad56-cad0-4ab3-853f-72e3a3d2117f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converting VIF {"id": "08acb0d5-2432-42fe-a372-78f11a73ed56", "address": "fa:16:3e:f1:93:45", "network": {"id": "05575fea-953f-4063-8670-e146f7767b37", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1036010436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edf25bcc0dea4d3eb1284e8995eb3466", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb0d5-24", "ovs_interfaceid": "08acb0d5-2432-42fe-a372-78f11a73ed56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:93:45,bridge_name='br-int',has_traffic_filtering=True,id=08acb0d5-2432-42fe-a372-78f11a73ed56,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb0d5-24') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG os_vif [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:93:45,bridge_name='br-int',has_traffic_filtering=True,id=08acb0d5-2432-42fe-a372-78f11a73ed56,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb0d5-24') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08acb0d5-24, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:04:14 user nova-compute[71308]: INFO os_vif [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:93:45,bridge_name='br-int',has_traffic_filtering=True,id=08acb0d5-2432-42fe-a372-78f11a73ed56,network=Network(05575fea-953f-4063-8670-e146f7767b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb0d5-24')
Apr 14 19:04:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Deleting instance files /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f_del
Apr 14 19:04:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Deletion of /opt/stack/data/nova/instances/15ebad56-cad0-4ab3-853f-72e3a3d2117f_del complete
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:14 user nova-compute[71308]: INFO nova.compute.manager [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 19:04:14 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:04:14 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:04:15 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:04:15 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:15 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:04:16 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Took 1.14 seconds to deallocate network for instance.
Apr 14 19:04:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-bf5a2bea-170d-44e1-bd31-4f65637e1639 req-0b73ea7e-f26a-4217-a250-1ee1e29852d6 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received event network-vif-deleted-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received event network-vif-plugged-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] Acquiring lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] No waiting events found dispatching network-vif-plugged-08acb0d5-2432-42fe-a372-78f11a73ed56 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:04:16 user nova-compute[71308]: WARNING nova.compute.manager [req-a4687877-1bd1-4985-aaf6-00b899a530be req-f8fff15e-4ab4-4b85-acdc-7a8b6cf944c6 service nova] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Received unexpected event network-vif-plugged-08acb0d5-2432-42fe-a372-78f11a73ed56 for instance with vm_state deleted and task_state None.
Apr 14 19:04:16 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:16 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Deleted allocations for instance 15ebad56-cad0-4ab3-853f-72e3a3d2117f
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4ad46089-0bc0-4c99-aaff-f85c99d9b2aa tempest-AttachVolumeTestJSON-1126291015 tempest-AttachVolumeTestJSON-1126291015-project-member] Lock "15ebad56-cad0-4ab3-853f-72e3a3d2117f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.708s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:18 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:04:18 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:04:18 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=26.190528869628906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Applying migration context for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 as it has an incoming, in-progress migration dffada2d-f093-4199-b1c7-9f2f343bc5f6. Migration status is finished {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 19:04:19 user nova-compute[71308]: INFO nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating resource usage from migration dffada2d-f093-4199-b1c7-9f2f343bc5f6
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 05891511-e84c-4fe3-a688-edcc27849d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 46d51513-1995-43c5-976a-40789ae575f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Migration dffada2d-f093-4199-b1c7-9f2f343bc5f6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a9379580-fd2f-4468-9ed3-7109735195be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:20 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:20 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:04:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:04:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:04:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:04:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Updating instance_info_cache with network_info: [{"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:04:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-cf640f3e-3d77-46ee-8a11-e0bdc870ff97" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:04:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:04:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:04:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:04:26 user nova-compute[71308]: INFO nova.compute.claims [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Claim successful on node user
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.network.neutron [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:04:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.policy [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:04:26 user nova-compute[71308]: INFO nova.virt.block_device [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Booting with volume 126e30a2-deeb-433e-a8b5-e9970ffc15af at /dev/vda
Apr 14 19:04:26 user nova-compute[71308]: DEBUG os_brick.utils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbee9645-864f-42bb-a69d-a725ccfa5e89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[696f44de-683a-425a-bf7d-9fc34af25b6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8a5775-aabd-455c-bed4-a42883f8f74b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a2d8bd-e925-4e11-a7ac-fc70e8fc39a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:04:26 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:04:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[225c3774-2724-48d4-9216-5272927a46e5]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG os_brick.utils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:04:26 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Updating existing volume attachment record: 3d3e7c0b-3908-46c8-8214-bdeee647f26f {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:04:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Successfully created port: 7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:04:28 user nova-compute[71308]: DEBUG nova.network.neutron [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Successfully updated port: 7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:04:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "refresh_cache-f3fde6b1-ddc9-400e-a032-f80cd32bad39" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:04:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquired lock "refresh_cache-f3fde6b1-ddc9-400e-a032-f80cd32bad39" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:04:28 user nova-compute[71308]: DEBUG nova.network.neutron [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:04:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received event network-changed-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Refreshing instance network info cache due to event network-changed-7527e5c9-4845-43dd-970d-b0072b4c0639. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:04:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] Acquiring lock "refresh_cache-f3fde6b1-ddc9-400e-a032-f80cd32bad39" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:04:28 user nova-compute[71308]: DEBUG nova.network.neutron [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:04:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG nova.network.neutron [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Updating instance_info_cache with network_info: [{"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Releasing lock "refresh_cache-f3fde6b1-ddc9-400e-a032-f80cd32bad39" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Instance network_info: |[{"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] Acquired lock "refresh_cache-f3fde6b1-ddc9-400e-a032-f80cd32bad39" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Refreshing network info cache for port 7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Updated VIF entry in instance network info cache for port 7527e5c9-4845-43dd-970d-b0072b4c0639. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG nova.network.neutron [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Updating instance_info_cache with network_info: [{"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-fa113b31-ccc0-4dd5-8bc3-498252448916 req-19769a40-c690-4120-bad6-c74433cc8bdc service nova] Releasing lock "refresh_cache-f3fde6b1-ddc9-400e-a032-f80cd32bad39" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499054.8990362, 15ebad56-cad0-4ab3-853f-72e3a3d2117f => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:04:29 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] VM Stopped (Lifecycle Event)
Apr 14 19:04:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-419fa43a-3a01-4586-8100-75b45c110909 None None] [instance: 15ebad56-cad0-4ab3-853f-72e3a3d2117f] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:04:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:04:31 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Creating image(s)
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Ensure instance console log exists: /opt/stack/data/nova/instances/f3fde6b1-ddc9-400e-a032-f80cd32bad39/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Start _get_guest_xml network_info=[{"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '3d3e7c0b-3908-46c8-8214-bdeee647f26f', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXLsZHeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f3fde6b1-ddc9-400e-a032-f80cd32bad39', 'attached_at': '', 'detached_at': '', 'volume_id': '126e30a2-deeb-433e-a8b5-e9970ffc15af', 'serial': '126e30a2-deeb-433e-a8b5-e9970ffc15af'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:04:31 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:04:31 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXLsZHeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:04:31 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:04:31 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:04:31 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[261bc344-a6c3-405b-bbba-77728d225f7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:04:31 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef17488-da4b-43f4-b8c6-807a56e8409e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af] added
Apr 14 19:04:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1009a2a-3727-4ea4-bb49-7b1131629ba7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1ec0d1-01b2-4419-bfe1-5eba2773ec9d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXLsZHeV {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXLsZHeV" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08cdbff-0707-4649-b5e5-2bfb4e94f726]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXLsZHeV'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17b248-3cb6-428d-8642-2d7465dd6db3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2f3800-85b0-4eb5-be34-3486e721b396]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb6b8d-b269-4e7d-ab13-2d87ebb251a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260]
Apr 14 19:04:31 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260] successful.
Apr 14 19:04:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54d8bef-3c0b-46aa-8f73-8bfc21456a7a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd497c58-fbdf-472c-93f5-f5ce576243bd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:04:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:31 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:04:31 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aa5ce9-a70b-4c46-affc-864280b1f519]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:04:31 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXLsZHeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26537313064393666', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537313064393666', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-152862803',display_name='tempest-TestVolumeBootPattern-server-152862803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-152862803',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg==',key_name='tempest-TestVolumeBootPattern-875294368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-79bo0y3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:04:27Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=f3fde6b1-ddc9-400e-a032-f80cd32bad39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:57:a8,bridge_name='br-int',has_traffic_filtering=True,id=7527e5c9-4845-43dd-970d-b0072b4c0639,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7527e5c9-48') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG nova.objects.instance [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'pci_devices' on Instance uuid f3fde6b1-ddc9-400e-a032-f80cd32bad39 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:04:32 user nova-compute[71308]:   <uuid>f3fde6b1-ddc9-400e-a032-f80cd32bad39</uuid>
Apr 14 19:04:32 user nova-compute[71308]:   <name>instance-00000028</name>
Apr 14 19:04:32 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:04:32 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:04:32 user nova-compute[71308]:   <metadata>
Apr 14 19:04:32 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:04:32 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:04:32 user nova-compute[71308]:       <nova:name>tempest-TestVolumeBootPattern-server-152862803</nova:name>
Apr 14 19:04:32 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:04:31</nova:creationTime>
Apr 14 19:04:32 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:04:32 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:04:32 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:04:32 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:04:32 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:04:32 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:04:32 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:04:32 user nova-compute[71308]:       <nova:owner>
Apr 14 19:04:32 user nova-compute[71308]:         <nova:user uuid="fc3bed70703a49c8bdec2f50193c7f70">tempest-TestVolumeBootPattern-1560263906-project-member</nova:user>
Apr 14 19:04:32 user nova-compute[71308]:         <nova:project uuid="72d2bf68325a4a18934a8403571c24bb">tempest-TestVolumeBootPattern-1560263906</nova:project>
Apr 14 19:04:32 user nova-compute[71308]:       </nova:owner>
Apr 14 19:04:32 user nova-compute[71308]:       <nova:ports>
Apr 14 19:04:32 user nova-compute[71308]:         <nova:port uuid="7527e5c9-4845-43dd-970d-b0072b4c0639">
Apr 14 19:04:32 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 19:04:32 user nova-compute[71308]:         </nova:port>
Apr 14 19:04:32 user nova-compute[71308]:       </nova:ports>
Apr 14 19:04:32 user nova-compute[71308]:     </nova:instance>
Apr 14 19:04:32 user nova-compute[71308]:   </metadata>
Apr 14 19:04:32 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:04:32 user nova-compute[71308]:     <system>
Apr 14 19:04:32 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:04:32 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:04:32 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:04:32 user nova-compute[71308]:       <entry name="serial">f3fde6b1-ddc9-400e-a032-f80cd32bad39</entry>
Apr 14 19:04:32 user nova-compute[71308]:       <entry name="uuid">f3fde6b1-ddc9-400e-a032-f80cd32bad39</entry>
Apr 14 19:04:32 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:04:32 user nova-compute[71308]:     </system>
Apr 14 19:04:32 user nova-compute[71308]:   </sysinfo>
Apr 14 19:04:32 user nova-compute[71308]:   <os>
Apr 14 19:04:32 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:04:32 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:04:32 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:04:32 user nova-compute[71308]:   </os>
Apr 14 19:04:32 user nova-compute[71308]:   <features>
Apr 14 19:04:32 user nova-compute[71308]:     <acpi/>
Apr 14 19:04:32 user nova-compute[71308]:     <apic/>
Apr 14 19:04:32 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:04:32 user nova-compute[71308]:   </features>
Apr 14 19:04:32 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:04:32 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:04:32 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:04:32 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:04:32 user nova-compute[71308]:   </clock>
Apr 14 19:04:32 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:04:32 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:04:32 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:04:32 user nova-compute[71308]:   </cpu>
Apr 14 19:04:32 user nova-compute[71308]:   <devices>
Apr 14 19:04:32 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 19:04:32 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:04:32 user nova-compute[71308]:       <source dev="/dev/sdc"/>
Apr 14 19:04:32 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:04:32 user nova-compute[71308]:       <serial>126e30a2-deeb-433e-a8b5-e9970ffc15af</serial>
Apr 14 19:04:32 user nova-compute[71308]:     </disk>
Apr 14 19:04:32 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:04:32 user nova-compute[71308]:       <mac address="fa:16:3e:61:57:a8"/>
Apr 14 19:04:32 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:04:32 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:04:32 user nova-compute[71308]:       <target dev="tap7527e5c9-48"/>
Apr 14 19:04:32 user nova-compute[71308]:     </interface>
Apr 14 19:04:32 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:04:32 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/f3fde6b1-ddc9-400e-a032-f80cd32bad39/console.log" append="off"/>
Apr 14 19:04:32 user nova-compute[71308]:     </serial>
Apr 14 19:04:32 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:04:32 user nova-compute[71308]:     <video>
Apr 14 19:04:32 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:04:32 user nova-compute[71308]:     </video>
Apr 14 19:04:32 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:04:32 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:04:32 user nova-compute[71308]:     </rng>
Apr 14 19:04:32 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:04:32 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:04:32 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:04:32 user nova-compute[71308]:     </memballoon>
Apr 14 19:04:32 user nova-compute[71308]:   </devices>
Apr 14 19:04:32 user nova-compute[71308]: </domain>
Apr 14 19:04:32 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-152862803',display_name='tempest-TestVolumeBootPattern-server-152862803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-152862803',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg==',key_name='tempest-TestVolumeBootPattern-875294368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-79bo0y3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:04:27Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=f3fde6b1-ddc9-400e-a032-f80cd32bad39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:57:a8,bridge_name='br-int',has_traffic_filtering=True,id=7527e5c9-4845-43dd-970d-b0072b4c0639,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7527e5c9-48') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG os_vif [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:57:a8,bridge_name='br-int',has_traffic_filtering=True,id=7527e5c9-4845-43dd-970d-b0072b4c0639,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7527e5c9-48') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7527e5c9-48, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7527e5c9-48, col_values=(('external_ids', {'iface-id': '7527e5c9-4845-43dd-970d-b0072b4c0639', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:57:a8', 'vm-uuid': 'f3fde6b1-ddc9-400e-a032-f80cd32bad39'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:04:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:32 user nova-compute[71308]: INFO os_vif [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:57:a8,bridge_name='br-int',has_traffic_filtering=True,id=7527e5c9-4845-43dd-970d-b0072b4c0639,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7527e5c9-48')
Apr 14 19:04:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:04:33 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No VIF found with MAC fa:16:3e:61:57:a8, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received event network-vif-plugged-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] Acquiring lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] No waiting events found dispatching network-vif-plugged-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:04:34 user nova-compute[71308]: WARNING nova.compute.manager [req-11678f70-62a1-46bc-929c-7aefd3a711ee req-f03ab6ab-4cbc-491e-8f13-c34240e63bcb service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received unexpected event network-vif-plugged-7527e5c9-4845-43dd-970d-b0072b4c0639 for instance with vm_state building and task_state spawning.
Apr 14 19:04:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.compute.manager [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received event network-vif-plugged-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] Acquiring lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.compute.manager [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] No waiting events found dispatching network-vif-plugged-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:04:36 user nova-compute[71308]: WARNING nova.compute.manager [req-4b5551e1-a177-4200-98a4-299d99e064ab req-6b277796-54b3-4ea9-8459-4fa845c8d19a service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received unexpected event network-vif-plugged-7527e5c9-4845-43dd-970d-b0072b4c0639 for instance with vm_state building and task_state spawning.
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499076.6667879, f3fde6b1-ddc9-400e-a032-f80cd32bad39 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:04:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] VM Resumed (Lifecycle Event)
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:04:36 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Instance spawned successfully.
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:04:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499076.6707106, f3fde6b1-ddc9-400e-a032-f80cd32bad39 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:04:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] VM Started (Lifecycle Event)
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:04:36 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:04:36 user nova-compute[71308]: INFO nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Took 5.27 seconds to spawn the instance on the hypervisor.
Apr 14 19:04:36 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:04:36 user nova-compute[71308]: INFO nova.compute.manager [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Took 10.89 seconds to build instance.
Apr 14 19:04:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-9c8040e1-e8c0-4d32-b9b8-9aff32350d28 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.985s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-changed-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Refreshing instance network info cache due to event network-changed-dff6b65b-1de5-4cb6-b5dd-778d05760cbd. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:04:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] Acquiring lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:04:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] Acquired lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:04:43 user nova-compute[71308]: DEBUG nova.network.neutron [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Refreshing network info cache for port dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:04:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:43 user nova-compute[71308]: INFO nova.compute.manager [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Detaching volume 61176d19-dc87-4e57-9b3c-6ba547a237eb
Apr 14 19:04:44 user nova-compute[71308]: INFO nova.virt.block_device [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Attempting to driver detach volume 61176d19-dc87-4e57-9b3c-6ba547a237eb from mountpoint /dev/vdb
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Attempting to detach device vdb from instance 05891511-e84c-4fe3-a688-edcc27849d58 from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:04:44 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:04:44 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 19:04:44 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:04:44 user nova-compute[71308]:   <serial>61176d19-dc87-4e57-9b3c-6ba547a237eb</serial>
Apr 14 19:04:44 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:04:44 user nova-compute[71308]: </disk>
Apr 14 19:04:44 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:04:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Successfully detached device vdb from instance 05891511-e84c-4fe3-a688-edcc27849d58 from the persistent domain config.
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 05891511-e84c-4fe3-a688-edcc27849d58 from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:04:44 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:04:44 user nova-compute[71308]:   <source dev="/dev/sdf"/>
Apr 14 19:04:44 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:04:44 user nova-compute[71308]:   <serial>61176d19-dc87-4e57-9b3c-6ba547a237eb</serial>
Apr 14 19:04:44 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:04:44 user nova-compute[71308]: </disk>
Apr 14 19:04:44 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updated VIF entry in instance network info cache for port dff6b65b-1de5-4cb6-b5dd-778d05760cbd. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating instance_info_cache with network_info: [{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-585afcbc-94bb-47e8-a3fe-bcf817befeb7 req-8d7d725c-cc75-4b1e-8636-d742ed51eda8 service nova] Releasing lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681499084.4783735, 05891511-e84c-4fe3-a688-edcc27849d58 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 19:04:44 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Successfully detached device vdb from instance 05891511-e84c-4fe3-a688-edcc27849d58 from the live domain config.
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lDjshJXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:04:44 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[608c8303-404c-40d0-872a-089dbe93cb06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:04:44 user nova-compute[71308]: No targets found.
Apr 14 19:04:44 user nova-compute[71308]: iSNS:
Apr 14 19:04:44 user nova-compute[71308]: No targets found.
Apr 14 19:04:44 user nova-compute[71308]: STATIC:
Apr 14 19:04:44 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:04:44 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:44 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:44 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:04:44 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:44 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:44 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb
Apr 14 19:04:44 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:44 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:44 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 19:04:44 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:44 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:44 user nova-compute[71308]: FIRMWARE:
Apr 14 19:04:44 user nova-compute[71308]: No targets found.
Apr 14 19:04:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:04:44 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:04:44 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb2a7bc-7ae8-4549-abce-504ac94d4499]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[037ff70f-733a-43ff-ac2e-a0ccea3973b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:44 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:44 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:44 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:04:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:44 user nova-compute[71308]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb (non-flash)
Apr 14 19:04:44 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:44 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:04:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aae0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb'): ({'sdf'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Removing single pathed devices sdf {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[256170de-96ff-446d-a864-28934d0d0705]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6e8a12-8bf2-4b4c-ac9e-eeea56f8fcfc]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Flushing IO for device /dev/sdf {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb87f886-f661-4b95-ad24-202ccfe320a8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f086671-acc2-4cbf-85b1-2c6f6b182bd1]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] SCSI volumes sdf have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[798162bf-c7fa-40c4-9471-b38a20bafe21]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fafb160-7a61-4884-86ed-25691c415080]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb, portal: 172.16.0.220,3260]
Apr 14 19:04:44 user nova-compute[71308]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb, portal: 172.16.0.220,3260] successful.
Apr 14 19:04:44 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61176d19-dc87-4e57-9b3c-6ba547a237eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf34a002-5c2d-4b14-b589-ec27a44ae6a2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] <== disconnect_volume: return (338ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:04:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:04:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-changed-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Refreshing instance network info cache due to event network-changed-dff6b65b-1de5-4cb6-b5dd-778d05760cbd. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:04:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] Acquiring lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:04:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] Acquired lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:04:45 user nova-compute[71308]: DEBUG nova.network.neutron [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Refreshing network info cache for port dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:04:45 user nova-compute[71308]: DEBUG nova.objects.instance [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'flavor' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:04:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-64721406-078d-4d89-8e3c-d6f811033ce4 tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:46 user nova-compute[71308]: DEBUG nova.network.neutron [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updated VIF entry in instance network info cache for port dff6b65b-1de5-4cb6-b5dd-778d05760cbd. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:04:46 user nova-compute[71308]: DEBUG nova.network.neutron [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating instance_info_cache with network_info: [{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:04:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-61049dd6-9990-4b1b-90f9-0d87a4cecf36 req-051abb91-5ba5-44d2-9a92-e46da1a2f4e7 service nova] Releasing lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:04:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:49 user nova-compute[71308]: INFO nova.compute.manager [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Terminating instance
Apr 14 19:04:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-unplugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-unplugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:04:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-e216209c-7c91-4f9d-9d91-d169f2bf3913 req-8d7c9652-eead-4abe-ba60-f5ebeeb49dfc service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-unplugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:04:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Instance destroyed successfully.
Apr 14 19:04:50 user nova-compute[71308]: DEBUG nova.objects.instance [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'resources' on Instance uuid 23d14a51-41aa-4827-bd60-c605d9689bc8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1219397521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1219397521',id=14,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:51:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-8vhrdkcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:52:49Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=23d14a51-41aa-4827-bd60-c605d9689bc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "b8044678-899b-4461-bbf0-cf9fd662e71e", "address": "fa:16:3e:90:27:c8", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8044678-89", "ovs_interfaceid": "b8044678-899b-4461-bbf0-cf9fd662e71e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:27:c8,bridge_name='br-int',has_traffic_filtering=True,id=b8044678-899b-4461-bbf0-cf9fd662e71e,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8044678-89') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_vif [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:27:c8,bridge_name='br-int',has_traffic_filtering=True,id=b8044678-899b-4461-bbf0-cf9fd662e71e,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8044678-89') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8044678-89, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:04:50 user nova-compute[71308]: INFO os_vif [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:27:c8,bridge_name='br-int',has_traffic_filtering=True,id=b8044678-899b-4461-bbf0-cf9fd662e71e,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8044678-89')
Apr 14 19:04:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qosgFUfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:04:50 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6523745a-7fe0-4e74-9ff4-e0d5fe21e4d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:04:50 user nova-compute[71308]: No targets found.
Apr 14 19:04:50 user nova-compute[71308]: iSNS:
Apr 14 19:04:50 user nova-compute[71308]: No targets found.
Apr 14 19:04:50 user nova-compute[71308]: STATIC:
Apr 14 19:04:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:04:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:04:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:50 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955
Apr 14 19:04:50 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:04:50 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:04:50 user nova-compute[71308]: FIRMWARE:
Apr 14 19:04:50 user nova-compute[71308]: No targets found.
Apr 14 19:04:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:04:50 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:04:50 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf81045e-7592-469e-b143-003086b74d3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d4fd2f-5bc5-4d0a-b526-a075d44840d1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:50 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:50 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:04:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 (non-flash)
Apr 14 19:04:50 user nova-compute[71308]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:04:50 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:04:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f223032d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955'): ({'sdd'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Removing single pathed devices sdd {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[94432164-755e-4793-8d5a-19c4631ae9f2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b2c479-09d2-44be-bc38-56f8b50e0290]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Flushing IO for device /dev/sdd {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2930a2ad-1c28-4cba-a9aa-60d0382eb198]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb08ff8-6c1a-4117-8889-adf48b8aee07]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] SCSI volumes sdd have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c9dadc-4413-4d27-8af6-60ac21d03e99]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[77967025-2f19-459b-883d-15e213433a2d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955, portal: 172.16.0.220,3260]
Apr 14 19:04:50 user nova-compute[71308]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955, portal: 172.16.0.220,3260] successful.
Apr 14 19:04:50 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45b3dec9-bffa-4042-b85b-b8f6620c5955 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72cf3e8-3fa1-4f02-939c-5625ac62fc50]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] <== disconnect_volume: return (307ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:04:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Deleting instance files /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8_del
Apr 14 19:04:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Deletion of /opt/stack/data/nova/instances/23d14a51-41aa-4827-bd60-c605d9689bc8_del complete
Apr 14 19:04:50 user nova-compute[71308]: INFO nova.compute.manager [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 14 19:04:50 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:04:50 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:04:51 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:04:51 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Took 0.55 seconds to deallocate network for instance.
Apr 14 19:04:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-deleted-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:51 user nova-compute[71308]: INFO nova.compute.manager [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Neutron deleted interface b8044678-899b-4461-bbf0-cf9fd662e71e; detaching it from the instance and deleting it from the info cache
Apr 14 19:04:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:04:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-609ef733-e75c-4a10-b7aa-28513a0c16d9 req-60c2598f-97dc-418e-a32d-2c8c834a6df4 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Detach interface failed, port_id=b8044678-899b-4461-bbf0-cf9fd662e71e, reason: Instance 23d14a51-41aa-4827-bd60-c605d9689bc8 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 19:04:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:04:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] Acquiring lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] No waiting events found dispatching network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:04:51 user nova-compute[71308]: WARNING nova.compute.manager [req-311f7458-29fd-449b-9922-bf96a106f6ea req-045245d9-4fc7-4d84-af97-c5192e626c85 service nova] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Received unexpected event network-vif-plugged-b8044678-899b-4461-bbf0-cf9fd662e71e for instance with vm_state active and task_state deleting.
Apr 14 19:04:51 user nova-compute[71308]: INFO nova.compute.manager [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 19:04:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:04:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:04:52 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:04:52 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:04:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:52 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Deleted allocations for instance 23d14a51-41aa-4827-bd60-c605d9689bc8
Apr 14 19:04:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-35ac8a5e-c339-4515-abfc-97f6c7ac9933 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "23d14a51-41aa-4827-bd60-c605d9689bc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.017s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:04:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:04:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:05:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:05 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499090.1719723, 23d14a51-41aa-4827-bd60-c605d9689bc8 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:05:05 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] VM Stopped (Lifecycle Event)
Apr 14 19:05:05 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b8196c16-f63f-42aa-8035-be4be3ba33b1 None None] [instance: 23d14a51-41aa-4827-bd60-c605d9689bc8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:05:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:06 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:05:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:10 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:05:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:05:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:14 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:05:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:05:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:15 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:05:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:05:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:16 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:05:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-changed-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Refreshing instance network info cache due to event network-changed-fef01e15-9070-4b0b-ba18-0b9540774cb9. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] Acquiring lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] Acquired lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG nova.network.neutron [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Refreshing network info cache for port fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:05:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:05:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=26.17953109741211GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Applying migration context for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 as it has an incoming, in-progress migration dffada2d-f093-4199-b1c7-9f2f343bc5f6. Migration status is finished {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 19:05:20 user nova-compute[71308]: INFO nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating resource usage from migration dffada2d-f093-4199-b1c7-9f2f343bc5f6
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 05891511-e84c-4fe3-a688-edcc27849d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 46d51513-1995-43c5-976a-40789ae575f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Migration dffada2d-f093-4199-b1c7-9f2f343bc5f6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a9379580-fd2f-4468-9ed3-7109735195be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.network.neutron [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updated VIF entry in instance network info cache for port fef01e15-9070-4b0b-ba18-0b9540774cb9. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.network.neutron [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating instance_info_cache with network_info: [{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-e85b82fa-132c-4f3e-a16b-4302fd9e74f3 req-2bbbed2b-696a-4e2c-8dd5-556b0d452238 service nova] Releasing lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:05:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:05:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:05:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:05:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:05:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:05:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:05:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:05:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating instance_info_cache with network_info: [{"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:05:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-05891511-e84c-4fe3-a688-edcc27849d58" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:05:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:05:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:22 user nova-compute[71308]: INFO nova.compute.manager [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Shelving
Apr 14 19:05:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-unplugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-unplugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:05:23 user nova-compute[71308]: WARNING nova.compute.manager [req-efa8ac3e-5340-41a0-871d-a20e1474f205 req-17884ce1-3715-4a19-88c9-171215587370 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-unplugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state active and task_state shelving.
Apr 14 19:05:23 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance destroyed successfully.
Apr 14 19:05:23 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Beginning cold snapshot process
Apr 14 19:05:23 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk /opt/stack/data/nova/instances/snapshots/tmp5jixxyim/16ee7b3a03554924811698eb5d985903 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk /opt/stack/data/nova/instances/snapshots/tmp5jixxyim/16ee7b3a03554924811698eb5d985903" returned: 0 in 0.498s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Snapshot extracted, beginning image upload
Apr 14 19:05:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:05:25 user nova-compute[71308]: WARNING nova.compute.manager [req-957dbc85-19dc-4052-bbbd-669d2bb11fc1 req-582d1c51-4e55-478c-b3b1-be9d21d54f3e service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 19:05:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Snapshot image upload complete
Apr 14 19:05:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:05:26 user nova-compute[71308]: INFO nova.compute.manager [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Shelve offloading
Apr 14 19:05:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance destroyed successfully.
Apr 14 19:05:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:05:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:05:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquired lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:05:26 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:05:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating instance_info_cache with network_info: [{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:05:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Releasing lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:05:28 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance destroyed successfully.
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'resources' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1127447025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1127447025',id=38,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMie4jk+eKDDeaE+UlFjfMzkkdZn5tHrG2pp7P8c6d+PQZvYazMq2yTH5MI/VepSyomDJZZ/cTr9HacR1kMWge6kZ4qBZES1sp1DTJQpGt0DwmP8idMT1Qs9zoNJj5wRSQ==',key_name='tempest-keypair-1365704596',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-e2gxcjgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member',shelved_at='2023-04-14T19:05:26.650167',shelved_host='user',shelved_image_id='d0253af1-1f43-4136-a071-acd72ccaafed'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=179270ef-7866-4ee7-af13-ec3ea5e7525a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG os_vif [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfef01e15-90, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:05:28 user nova-compute[71308]: INFO os_vif [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90')
Apr 14 19:05:28 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Deleting instance files /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a_del
Apr 14 19:05:28 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Deletion of /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a_del complete
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-changed-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Refreshing instance network info cache due to event network-changed-fef01e15-9070-4b0b-ba18-0b9540774cb9. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] Acquiring lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] Acquired lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Refreshing network info cache for port fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:05:28 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Deleted allocations for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a
Apr 14 19:05:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'numa_topology' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-f0cbe3b0-dd18-4abd-8506-4c94783d2885 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.725s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updated VIF entry in instance network info cache for port fef01e15-9070-4b0b-ba18-0b9540774cb9. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating instance_info_cache with network_info: [{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfef01e15-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-07169f58-e78e-486f-bef7-e8d7d59352f1 req-a8be0337-a417-4fcb-86e3-98d751dda97f service nova] Releasing lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:05:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Going to confirm migration 2 {{(pid=71308) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquired lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG nova.network.neutron [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG nova.objects.instance [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'info_cache' on Instance uuid d4a54fb1-bd66-42f5-9f8c-9fb40470f468 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG nova.network.neutron [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating instance_info_cache with network_info: [{"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Releasing lock "refresh_cache-d4a54fb1-bd66-42f5-9f8c-9fb40470f468" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG nova.objects.instance [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'migration_context' on Instance uuid d4a54fb1-bd66-42f5-9f8c-9fb40470f468 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:05:33 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:05:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.379s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:34 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Deleted allocation for migration dffada2d-f093-4199-b1c7-9f2f343bc5f6
Apr 14 19:05:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-373453c6-cdc7-4825-a6f0-c8c7a3c149d0 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.350s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:34 user nova-compute[71308]: INFO nova.compute.manager [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Terminating instance
Apr 14 19:05:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:05:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-unplugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-unplugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-49908c9d-ed7e-46b4-a4c4-41c2247148f0 req-fc6eff52-501b-46cd-97de-e006d1b051f9 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-unplugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:05:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Instance destroyed successfully.
Apr 14 19:05:35 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'resources' on Instance uuid 05891511-e84c-4fe3-a688-edcc27849d58 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-878359626',display_name='tempest-ServerRescueNegativeTestJSON-server-878359626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-878359626',id=33,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsV7S4Lu7EScb7Ca1HXXWHMkfNibGLUsHaVxGGFEiPOu+DZdxz7O+eYdDkk0eqIIMAOS8zIzZ1Dx0oJrzQLMfBVS8ZQb5vqX9QOfeUkQuI1qS8pmjCXzIvfDogAaOvDEA==',key_name='tempest-keypair-126127202',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:01:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-6n0xph1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=05891511-e84c-4fe3-a688-edcc27849d58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "address": "fa:16:3e:27:4f:50", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff6b65b-1d", "ovs_interfaceid": "dff6b65b-1de5-4cb6-b5dd-778d05760cbd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:4f:50,bridge_name='br-int',has_traffic_filtering=True,id=dff6b65b-1de5-4cb6-b5dd-778d05760cbd,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff6b65b-1d') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG os_vif [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:4f:50,bridge_name='br-int',has_traffic_filtering=True,id=dff6b65b-1de5-4cb6-b5dd-778d05760cbd,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff6b65b-1d') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdff6b65b-1d, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:05:35 user nova-compute[71308]: INFO os_vif [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:4f:50,bridge_name='br-int',has_traffic_filtering=True,id=dff6b65b-1de5-4cb6-b5dd-778d05760cbd,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff6b65b-1d')
Apr 14 19:05:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Deleting instance files /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58_del
Apr 14 19:05:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Deletion of /opt/stack/data/nova/instances/05891511-e84c-4fe3-a688-edcc27849d58_del complete
Apr 14 19:05:35 user nova-compute[71308]: INFO nova.compute.manager [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Took 1.03 seconds to destroy the instance on the hypervisor.
Apr 14 19:05:35 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:05:35 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:05:36 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:05:36 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Took 1.29 seconds to deallocate network for instance.
Apr 14 19:05:36 user nova-compute[71308]: DEBUG nova.compute.manager [req-a8aacaf1-2de4-45d0-8685-22076c7a556d req-7377bff1-9883-498f-82bd-56d76e0d1102 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-deleted-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:37 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:05:37 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:05:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:37 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Deleted allocations for instance 05891511-e84c-4fe3-a688-edcc27849d58
Apr 14 19:05:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] Acquiring lock "05891511-e84c-4fe3-a688-edcc27849d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] Lock "05891511-e84c-4fe3-a688-edcc27849d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] No waiting events found dispatching network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:05:37 user nova-compute[71308]: WARNING nova.compute.manager [req-28b5e9ce-b1e0-439e-917b-5d492c00149e req-44fa5749-6bba-4eda-9b23-b0255f9f39f4 service nova] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Received unexpected event network-vif-plugged-dff6b65b-1de5-4cb6-b5dd-778d05760cbd for instance with vm_state deleted and task_state None.
Apr 14 19:05:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d4257b07-3fea-4185-a40f-74e5ba5db6be tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "05891511-e84c-4fe3-a688-edcc27849d58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.032s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:38 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499123.5303173, 179270ef-7866-4ee7-af13-ec3ea5e7525a => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:05:38 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] VM Stopped (Lifecycle Event)
Apr 14 19:05:38 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9a7374b0-5c46-40b9-981f-3f0d47b48270 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:05:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:40 user nova-compute[71308]: INFO nova.compute.manager [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Terminating instance
Apr 14 19:05:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received event network-vif-unplugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] Acquiring lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] No waiting events found dispatching network-vif-unplugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:05:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-c0312f4f-894e-4b1e-b534-e9943d29367d req-9eef3748-b26a-49ab-8fc7-0cd5439e1120 service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received event network-vif-unplugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received event network-changed-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.compute.manager [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Refreshing instance network info cache due to event network-changed-f22a5e1e-5aed-419f-aa06-308984681fbc. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] Acquiring lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] Acquired lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.network.neutron [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Refreshing network info cache for port f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:05:41 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Instance destroyed successfully.
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lazy-loading 'resources' on Instance uuid 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1351271638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1351271638',id=1,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='424e732759884efa8fd126cd9a082c8a',ramdisk_id='',reservation_id='r-j8xv8pvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:47:59Z,user_data=None,user_id='a644b8bb9b90494ba670da8315bfe005',uuid=89d05353-f3a2-467d-9f7f-e0da1f0c4cc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converting VIF {"id": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "address": "fa:16:3e:d3:0d:88", "network": {"id": "a4933fe8-a8cc-498f-925f-185cdae2f1f7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-639671182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "424e732759884efa8fd126cd9a082c8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99d9a465-1b", "ovs_interfaceid": "99d9a465-1b2a-40bf-aafb-56e1a58ca1ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:0d:88,bridge_name='br-int',has_traffic_filtering=True,id=99d9a465-1b2a-40bf-aafb-56e1a58ca1ed,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d9a465-1b') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG os_vif [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:0d:88,bridge_name='br-int',has_traffic_filtering=True,id=99d9a465-1b2a-40bf-aafb-56e1a58ca1ed,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d9a465-1b') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99d9a465-1b, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:05:41 user nova-compute[71308]: INFO os_vif [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:0d:88,bridge_name='br-int',has_traffic_filtering=True,id=99d9a465-1b2a-40bf-aafb-56e1a58ca1ed,network=Network(a4933fe8-a8cc-498f-925f-185cdae2f1f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99d9a465-1b')
Apr 14 19:05:41 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Deleting instance files /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6_del
Apr 14 19:05:41 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Deletion of /opt/stack/data/nova/instances/89d05353-f3a2-467d-9f7f-e0da1f0c4cc6_del complete
Apr 14 19:05:41 user nova-compute[71308]: INFO nova.compute.manager [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.objects.instance [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:41 user nova-compute[71308]: INFO nova.compute.manager [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attaching volume 57840ae0-4cce-45c4-82e7-6942f8812b4a to /dev/vdb
Apr 14 19:05:41 user nova-compute[71308]: DEBUG os_brick.utils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f055b0-8998-40c9-a727-449ed50eb85c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e004694-227b-499d-b0ce-dd8e7f5402b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[356b7703-5a6e-4ec0-b9c2-e424be24dd79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[401efa44-04df-47f0-9e74-267c95b87dad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:05:41 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc54320f-d4b1-4f4d-9553-9f82ddc8093b]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG os_brick.utils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating existing volume attachment record: a4664806-37e6-4b5e-a62d-bec46fe052a6 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:05:41 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Took 0.60 seconds to deallocate network for instance.
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updated VIF entry in instance network info cache for port f22a5e1e-5aed-419f-aa06-308984681fbc. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating instance_info_cache with network_info: [{"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f47e5843-afc0-48b6-a4b9-19ce9740e7c1 req-be483b49-9cd5-41dd-8d91-4de729e0edb9 service nova] Releasing lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:05:42 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Deleted allocations for instance 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6
Apr 14 19:05:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ab674852-7c7c-4549-a7c8-984aef00d4c5 tempest-ServerBootFromVolumeStableRescueTest-1815450365 tempest-ServerBootFromVolumeStableRescueTest-1815450365-project-member] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received event network-vif-plugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] Acquiring lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] Lock "89d05353-f3a2-467d-9f7f-e0da1f0c4cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] No waiting events found dispatching network-vif-plugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:05:42 user nova-compute[71308]: WARNING nova.compute.manager [req-bb399d79-ab4f-4053-91ae-dd02afe4fc8f req-1bcac64a-be8c-4fe3-9c38-26dc39d6ea9f service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received unexpected event network-vif-plugged-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed for instance with vm_state deleted and task_state None.
Apr 14 19:05:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-bf30f00d-8996-4607-b3de-c0b413309865 req-7cfcd609-a8cd-4cd0-91fa-b0c90b0ca85b service nova] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Received event network-vif-deleted-99d9a465-1b2a-40bf-aafb-56e1a58ca1ed {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:05:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBWMdwZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:05:46 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:05:46 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:05:46 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d963b7-6757-4cf8-aa12-5399a3873267]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:05:46 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c27a1dd-3508-4ebb-b393-26649b63f1b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a] added
Apr 14 19:05:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7038c46c-6f49-4298-a575-f366c08ebc2a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[177217d8-8025-4bed-8920-44c31f365ca7]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TBWMdwZz {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TBWMdwZz" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e56a6e-6c87-44ad-a9e8-1099b7397890]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TBWMdwZz'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9312b5-5ea5-4dc2-b830-2f42632bf3b2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2dd202-b9ac-43a0-b5a4-26edb081a2cc]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:05:46 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:05:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:05:46 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:05:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c8d4a8-fd18-4a57-b374-0a582f19664c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a, portal: 172.16.0.220,3260]
Apr 14 19:05:46 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a, portal: 172.16.0.220,3260] successful.
Apr 14 19:05:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a85342-d4b1-41fe-9bca-ff682d37819a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9793cd82-65f9-4f5c-9581-7fb9149082b7]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:05:46 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:05:46 user nova-compute[71308]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a (non-flash)
Apr 14 19:05:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:05:46 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:05:46 user nova-compute[71308]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a (non-flash)
Apr 14 19:05:46 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69e5c62-9d57-4f7e-96d8-bb2f08c2bf91]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:05:46 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:05:47 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:05:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBWMdwZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:05:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:05:47 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23564336461303066', 'path': '/dev/sdd'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:05:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564336461303066', 'path': '/dev/sdd'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:05:47 user nova-compute[71308]: DEBUG nova.objects.instance [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:05:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 19:05:47 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:05:47 user nova-compute[71308]:   <source dev="/dev/sdd"/>
Apr 14 19:05:47 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:05:47 user nova-compute[71308]:   <serial>57840ae0-4cce-45c4-82e7-6942f8812b4a</serial>
Apr 14 19:05:47 user nova-compute[71308]: </disk>
Apr 14 19:05:47 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 19:05:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:05:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:05:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No VIF found with MAC fa:16:3e:9f:62:f6, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:05:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-99851048-20f6-4968-89a7-b26e28568e59 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.677s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:05:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:50 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499135.1820712, 05891511-e84c-4fe3-a688-edcc27849d58 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:05:50 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] VM Stopped (Lifecycle Event)
Apr 14 19:05:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-db496067-6ca3-458e-9a40-e076309f23cd None None] [instance: 05891511-e84c-4fe3-a688-edcc27849d58] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:05:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:56 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499141.0289302, 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:05:56 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] VM Stopped (Lifecycle Event)
Apr 14 19:05:56 user nova-compute[71308]: DEBUG nova.compute.manager [None req-0c473307-8f57-4f4c-98b8-40c0085e399e None None] [instance: 89d05353-f3a2-467d-9f7f-e0da1f0c4cc6] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:05:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:05:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:01 user nova-compute[71308]: INFO nova.compute.manager [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Detaching volume 57840ae0-4cce-45c4-82e7-6942f8812b4a
Apr 14 19:06:01 user nova-compute[71308]: INFO nova.virt.block_device [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attempting to driver detach volume 57840ae0-4cce-45c4-82e7-6942f8812b4a from mountpoint /dev/vdb
Apr 14 19:06:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Attempting to detach device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:06:01 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:06:01 user nova-compute[71308]:   <source dev="/dev/sdd"/>
Apr 14 19:06:01 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:06:01 user nova-compute[71308]:   <serial>57840ae0-4cce-45c4-82e7-6942f8812b4a</serial>
Apr 14 19:06:01 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:06:01 user nova-compute[71308]: </disk>
Apr 14 19:06:01 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:06:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully detached device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the persistent domain config.
Apr 14 19:06:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9379580-fd2f-4468-9ed3-7109735195be from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:06:01 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:06:01 user nova-compute[71308]:   <source dev="/dev/sdd"/>
Apr 14 19:06:01 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:06:01 user nova-compute[71308]:   <serial>57840ae0-4cce-45c4-82e7-6942f8812b4a</serial>
Apr 14 19:06:01 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:06:01 user nova-compute[71308]: </disk>
Apr 14 19:06:01 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681499161.8114903, a9379580-fd2f-4468-9ed3-7109735195be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 19:06:01 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully detached device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the live domain config.
Apr 14 19:06:01 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBWMdwZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:06:01 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d31359-69a6-4cd2-acf2-7d129f0e65a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:06:01 user nova-compute[71308]: No targets found.
Apr 14 19:06:01 user nova-compute[71308]: iSNS:
Apr 14 19:06:01 user nova-compute[71308]: No targets found.
Apr 14 19:06:01 user nova-compute[71308]: STATIC:
Apr 14 19:06:01 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:06:01 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:06:01 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:06:01 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a
Apr 14 19:06:01 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:06:01 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:06:01 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:06:01 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:06:01 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:06:01 user nova-compute[71308]: FIRMWARE:
Apr 14 19:06:01 user nova-compute[71308]: No targets found.
Apr 14 19:06:01 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:06:01 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:06:01 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e1279-6187-49dd-94b3-e05b1973a4a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34f5b96-2db1-4b47-9937-1e12f365d86a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:06:01 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:06:01 user nova-compute[71308]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a (non-flash)
Apr 14 19:06:01 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:06:01 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:06:01 user nova-compute[71308]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a (non-flash)
Apr 14 19:06:01 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aa70b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a'): ({'sdd'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Removing single pathed devices sdd {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e5e05-2378-4660-886b-1919238323ec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[54412c12-fff7-49e6-bcbb-7fd0e16704b9]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Flushing IO for device /dev/sdd {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f52790c-d70d-4396-8491-ec25f7075980]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:06:01 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eca4a25-dd68-4a8a-ac38-d245f6dee75e]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] SCSI volumes sdd have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[61213700-aaad-44cb-a82b-9b36c2095614]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c6924f-0fc4-419f-b5f6-fdf4b69b9d3a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a, portal: 172.16.0.220,3260]
Apr 14 19:06:02 user nova-compute[71308]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a, portal: 172.16.0.220,3260] successful.
Apr 14 19:06:02 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57840ae0-4cce-45c4-82e7-6942f8812b4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc954b8-dbed-4640-b3e7-e862f279e920]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== disconnect_volume: return (291ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:06:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c0f52931-d328-4ae8-81ab-5e2b6d4f0da9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.646s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:06:07 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:16 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:06:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:16 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received event network-changed-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Refreshing instance network info cache due to event network-changed-7527e5c9-4845-43dd-970d-b0072b4c0639. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] Acquiring lock "refresh_cache-f3fde6b1-ddc9-400e-a032-f80cd32bad39" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] Acquired lock "refresh_cache-f3fde6b1-ddc9-400e-a032-f80cd32bad39" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.network.neutron [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Refreshing network info cache for port 7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:06:19 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:06:19 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8022MB free_disk=26.270862579345703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 46d51513-1995-43c5-976a-40789ae575f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a9379580-fd2f-4468-9ed3-7109735195be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance f3fde6b1-ddc9-400e-a032-f80cd32bad39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:19 user nova-compute[71308]: INFO nova.compute.manager [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Terminating instance
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.manager [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received event network-vif-unplugged-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] Acquiring lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] No waiting events found dispatching network-vif-unplugged-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:06:19 user nova-compute[71308]: DEBUG nova.compute.manager [req-457db887-ae30-445d-b3fe-a95ad884b870 req-5704df2a-6984-4d40-98db-e4cd10bd7a1e service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received event network-vif-unplugged-7527e5c9-4845-43dd-970d-b0072b4c0639 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:20 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Instance destroyed successfully.
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.network.neutron [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Updated VIF entry in instance network info cache for port 7527e5c9-4845-43dd-970d-b0072b4c0639. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.network.neutron [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Updating instance_info_cache with network_info: [{"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.objects.instance [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'resources' on Instance uuid f3fde6b1-ddc9-400e-a032-f80cd32bad39 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-152862803',display_name='tempest-TestVolumeBootPattern-server-152862803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-152862803',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg==',key_name='tempest-TestVolumeBootPattern-875294368',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:04:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-79bo0y3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:04:37Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=f3fde6b1-ddc9-400e-a032-f80cd32bad39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "7527e5c9-4845-43dd-970d-b0072b4c0639", "address": "fa:16:3e:61:57:a8", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7527e5c9-48", "ovs_interfaceid": "7527e5c9-4845-43dd-970d-b0072b4c0639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:57:a8,bridge_name='br-int',has_traffic_filtering=True,id=7527e5c9-4845-43dd-970d-b0072b4c0639,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7527e5c9-48') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_vif [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:57:a8,bridge_name='br-int',has_traffic_filtering=True,id=7527e5c9-4845-43dd-970d-b0072b4c0639,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7527e5c9-48') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-53156946-7cc8-40b7-8cbd-9088449b7b91 req-4796c598-32bf-4b22-8399-d1b68f317dcf service nova] Releasing lock "refresh_cache-f3fde6b1-ddc9-400e-a032-f80cd32bad39" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7527e5c9-48, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:20 user nova-compute[71308]: INFO os_vif [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:57:a8,bridge_name='br-int',has_traffic_filtering=True,id=7527e5c9-4845-43dd-970d-b0072b4c0639,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7527e5c9-48')
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXLsZHeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:06:20 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a6ecb6-d779-4171-b585-8a4a9165b493]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:06:20 user nova-compute[71308]: No targets found.
Apr 14 19:06:20 user nova-compute[71308]: iSNS:
Apr 14 19:06:20 user nova-compute[71308]: No targets found.
Apr 14 19:06:20 user nova-compute[71308]: STATIC:
Apr 14 19:06:20 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:06:20 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:06:20 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:06:20 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:06:20 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:06:20 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:06:20 user nova-compute[71308]: FIRMWARE:
Apr 14 19:06:20 user nova-compute[71308]: No targets found.
Apr 14 19:06:20 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:06:20 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:06:20 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0000c16-cd19-4d83-a74f-a4b7b957fcda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e9213-8ab3-481a-aa41-c86c9c769b56]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:06:20 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:06:20 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:06:20 user nova-compute[71308]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:06:20 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f227aa70940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[31754ef4-a478-448e-9586-50905083fc9f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[997d1078-ecfe-4683-bae8-66dd4ad01dfc]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e807f09-7999-4283-be06-da2b65139787]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6448ee8-429a-41e0-bb21-6952754a1b52]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO560487d3-e710d96f04895ae3', '/dev/disk/by-id/scsi-26537313064393666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_560487d3') {{(pid=81547) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 19:06:20 user nova-compute[71308]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_560487d3
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0532aa6-ac4e-4a19-8972-b0cff4892988]: (4, None) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ad3a17-ab98-4b7a-b0c2-a4f9efe63604]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd93d6d-4698-4380-b43a-1bdbcb03a414]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260]
Apr 14 19:06:20 user nova-compute[71308]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260] successful.
Apr 14 19:06:20 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0129f731-eee1-4c10-bb79-aeca48dba136]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== disconnect_volume: return (337ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:06:20 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Deleting instance files /opt/stack/data/nova/instances/f3fde6b1-ddc9-400e-a032-f80cd32bad39_del
Apr 14 19:06:20 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Deletion of /opt/stack/data/nova/instances/f3fde6b1-ddc9-400e-a032-f80cd32bad39_del complete
Apr 14 19:06:20 user nova-compute[71308]: INFO nova.compute.manager [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:06:20 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:21 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:06:21 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Took 0.92 seconds to deallocate network for instance.
Apr 14 19:06:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received event network-vif-plugged-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:06:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] Acquiring lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] No waiting events found dispatching network-vif-plugged-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:06:22 user nova-compute[71308]: WARNING nova.compute.manager [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received unexpected event network-vif-plugged-7527e5c9-4845-43dd-970d-b0072b4c0639 for instance with vm_state active and task_state deleting.
Apr 14 19:06:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-9dc00262-2291-44e4-8434-6c518592fc63 req-b02411d2-3369-4192-b472-0c6c1b8ec6be service nova] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Received event network-vif-deleted-7527e5c9-4845-43dd-970d-b0072b4c0639 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:06:22 user nova-compute[71308]: INFO nova.compute.manager [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Took 0.96 seconds to detach 1 volumes for instance.
Apr 14 19:06:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:22 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:06:22 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:06:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:22 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Deleted allocations for instance f3fde6b1-ddc9-400e-a032-f80cd32bad39
Apr 14 19:06:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-4c854406-a712-4371-bb15-6355a1b61a0f tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "f3fde6b1-ddc9-400e-a032-f80cd32bad39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.510s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:06:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:06:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:06:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:06:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updating instance_info_cache with network_info: [{"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:06:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:06:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:06:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:25 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:06:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:06:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:34 user nova-compute[71308]: INFO nova.compute.manager [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Terminating instance
Apr 14 19:06:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:06:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499180.146644, f3fde6b1-ddc9-400e-a032-f80cd32bad39 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:06:35 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] VM Stopped (Lifecycle Event)
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-9615653c-fe0e-440a-8956-e5c26772c879 None None] [instance: f3fde6b1-ddc9-400e-a032-f80cd32bad39] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-unplugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] No waiting events found dispatching network-vif-unplugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.compute.manager [req-a9f2faa5-3d12-4266-b9ee-ae285c69acca req-1a5f17f0-e261-476c-a157-389a7e456f89 service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-unplugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Instance destroyed successfully.
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.objects.instance [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'resources' on Instance uuid cf640f3e-3d77-46ee-8a11-e0bdc870ff97 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-502749594',display_name='tempest-ServerRescueNegativeTestJSON-server-502749594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-502749594',id=17,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:52:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-ien3h5pp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:52:20Z,user_data=None,user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=cf640f3e-3d77-46ee-8a11-e0bdc870ff97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "address": "fa:16:3e:2c:ac:1c", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0e2f74-c7", "ovs_interfaceid": "ee0e2f74-c744-41ec-b3f8-c7d124c61f8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=ee0e2f74-c744-41ec-b3f8-c7d124c61f8e,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e2f74-c7') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG os_vif [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=ee0e2f74-c744-41ec-b3f8-c7d124c61f8e,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e2f74-c7') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee0e2f74-c7, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:06:35 user nova-compute[71308]: INFO os_vif [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ac:1c,bridge_name='br-int',has_traffic_filtering=True,id=ee0e2f74-c744-41ec-b3f8-c7d124c61f8e,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0e2f74-c7')
Apr 14 19:06:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Deleting instance files /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97_del
Apr 14 19:06:35 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Deletion of /opt/stack/data/nova/instances/cf640f3e-3d77-46ee-8a11-e0bdc870ff97_del complete
Apr 14 19:06:35 user nova-compute[71308]: INFO nova.compute.manager [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 19:06:35 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:06:35 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:06:36 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:06:36 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Took 1.17 seconds to deallocate network for instance.
Apr 14 19:06:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:36 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-08588a85-efe7-4b8c-8fbe-d0c9b27ef738 req-0f2a8323-ef49-443d-aa7b-920908d86f8c service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-deleted-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:06:37 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:06:37 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:06:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:37 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Deleted allocations for instance cf640f3e-3d77-46ee-8a11-e0bdc870ff97
Apr 14 19:06:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:06:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] Acquiring lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:37 user nova-compute[71308]: DEBUG nova.compute.manager [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] No waiting events found dispatching network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:06:37 user nova-compute[71308]: WARNING nova.compute.manager [req-6037a156-1502-4dcc-a70e-54a4b101b4ad req-73f988ee-ddd3-49cd-a4b3-d7b79396402f service nova] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Received unexpected event network-vif-plugged-ee0e2f74-c744-41ec-b3f8-c7d124c61f8e for instance with vm_state deleted and task_state None.
Apr 14 19:06:37 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cd743208-dcbb-4f51-893e-604aa809971e tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "cf640f3e-3d77-46ee-8a11-e0bdc870ff97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.533s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:50 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499195.5743437, cf640f3e-3d77-46ee-8a11-e0bdc870ff97 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:06:50 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] VM Stopped (Lifecycle Event)
Apr 14 19:06:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-152147a3-fd06-4785-b2b5-646b6c68973b None None] [instance: cf640f3e-3d77-46ee-8a11-e0bdc870ff97] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:06:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:06:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:06:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:58 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:06:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.289s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:06:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:06:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:06:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:06:58 user nova-compute[71308]: INFO nova.compute.manager [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attaching volume 8bd69239-e6ac-4562-82d2-0e37f8202f4d to /dev/vdb
Apr 14 19:06:59 user nova-compute[71308]: DEBUG os_brick.utils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2edc33b-7694-42e5-9a09-2bd53b1d6497]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5802a6-2e8e-47e2-a5a3-3f97e38d1a30]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9994d5-eba5-427d-87a5-4afe7a569c13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f7d419-a6e0-4dfd-b005-8c7d6c8e8326]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:06:59 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:06:59 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca45428a-8e3b-4541-86c8-fffbbd3049ac]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG os_brick.utils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:06:59 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating existing volume attachment record: 20a2af93-bc1d-48ec-b3c1-9446ef76e496 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:07:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqXLEcmH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:07:04 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:07:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:07:04 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:07:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:07:04 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:07:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c8848-f30c-4cf0-af49-98b0a7c0f749]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:07:04 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d126cd64-210b-4872-bda2-3539f07550ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d] added
Apr 14 19:07:04 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:04 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.052s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7984c36e-cd1f-45af-b596-e27a0f7ba0b3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[624f1fda-f1c1-499a-8e8b-b12ee88f312f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqXLEcmH {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pqXLEcmH" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a80f580-d108-46bb-8dcc-53ca5272d262]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pqXLEcmH'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70334da-3d0a-4908-986d-0240c333f95b]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acdd2d5-6a80-43f9-83f1-94d09c20a939]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[508af473-fbdb-41b2-b4fa-febd77d727e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d, portal: 172.16.0.220,3260]
Apr 14 19:07:05 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d, portal: 172.16.0.220,3260] successful.
Apr 14 19:07:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a751188-3b9e-43e2-a6f6-a0e00db51ddc]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c2b5b-090c-4a34-8d66-043c059e119f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:05 user nova-compute[71308]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d (non-flash)
Apr 14 19:07:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:05 user nova-compute[71308]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d (non-flash)
Apr 14 19:07:05 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d8a4ac-293d-46b3-8939-78f565b59f67]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqXLEcmH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:07:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:07:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23939333637626535', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:07:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939333637626535', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:07:06 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 19:07:06 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:07:06 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 19:07:06 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:07:06 user nova-compute[71308]:   <serial>8bd69239-e6ac-4562-82d2-0e37f8202f4d</serial>
Apr 14 19:07:06 user nova-compute[71308]: </disk>
Apr 14 19:07:06 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 19:07:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:07:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:07:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No VIF found with MAC fa:16:3e:9f:62:f6, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:07:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c06d28df-8a20-4518-83db-a19a33d4785a tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.890s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:08 user nova-compute[71308]: INFO nova.compute.manager [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Detaching volume 8bd69239-e6ac-4562-82d2-0e37f8202f4d
Apr 14 19:07:08 user nova-compute[71308]: INFO nova.virt.block_device [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attempting to driver detach volume 8bd69239-e6ac-4562-82d2-0e37f8202f4d from mountpoint /dev/vdb
Apr 14 19:07:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Attempting to detach device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 19:07:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:07:08 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:07:08 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 19:07:08 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:07:08 user nova-compute[71308]:   <serial>8bd69239-e6ac-4562-82d2-0e37f8202f4d</serial>
Apr 14 19:07:08 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:07:08 user nova-compute[71308]: </disk>
Apr 14 19:07:08 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:07:08 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully detached device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the persistent domain config.
Apr 14 19:07:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9379580-fd2f-4468-9ed3-7109735195be from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 19:07:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:07:08 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:07:08 user nova-compute[71308]:   <source dev="/dev/sdc"/>
Apr 14 19:07:08 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:07:08 user nova-compute[71308]:   <serial>8bd69239-e6ac-4562-82d2-0e37f8202f4d</serial>
Apr 14 19:07:08 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:07:08 user nova-compute[71308]: </disk>
Apr 14 19:07:08 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:07:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681499229.0965838, a9379580-fd2f-4468-9ed3-7109735195be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 19:07:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully detached device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the live domain config.
Apr 14 19:07:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pqXLEcmH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:07:09 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d606a-35fb-4a79-a11a-d8cea5097cb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:07:09 user nova-compute[71308]: No targets found.
Apr 14 19:07:09 user nova-compute[71308]: iSNS:
Apr 14 19:07:09 user nova-compute[71308]: No targets found.
Apr 14 19:07:09 user nova-compute[71308]: STATIC:
Apr 14 19:07:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:07:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:07:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:07:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d
Apr 14 19:07:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:07:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:07:09 user nova-compute[71308]: FIRMWARE:
Apr 14 19:07:09 user nova-compute[71308]: No targets found.
Apr 14 19:07:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:07:09 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:07:09 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[12001f2a-c891-4333-a6fa-5d7ac5caf810]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b29dce-cf1b-4a5f-a99f-1ff7b0843106]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:09 user nova-compute[71308]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d (non-flash)
Apr 14 19:07:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:09 user nova-compute[71308]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d (non-flash)
Apr 14 19:07:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f223032d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4991b2d2-6b64-443a-86c2-5eb7e56e5fe2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4652d962-01d4-4bef-9605-2608ace86979]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f0cc55-1972-4257-93fe-8a13dc8f0321]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae63f4b-c003-4f75-95bc-84a6a7ba9edc]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6f94b5-dd7d-4da1-bd0f-e0685a22b016]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac163b98-1949-4c19-804e-459d0132a967]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d, portal: 172.16.0.220,3260]
Apr 14 19:07:09 user nova-compute[71308]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d, portal: 172.16.0.220,3260] successful.
Apr 14 19:07:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd69239-e6ac-4562-82d2-0e37f8202f4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8458f-b081-40aa-bcf7-76ffdb23061b]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== disconnect_volume: return (281ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:07:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:10 user nova-compute[71308]: DEBUG nova.objects.instance [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-beb537b7-2528-43d5-9e71-e2d56a432cd9 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.732s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "935022b4-4ba7-4b34-a758-a00081240b4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "935022b4-4ba7-4b34-a758-a00081240b4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:07:11 user nova-compute[71308]: INFO nova.compute.claims [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Claim successful on node user
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:07:11 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:07:11 user nova-compute[71308]: INFO nova.virt.block_device [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Booting with volume 126e30a2-deeb-433e-a8b5-e9970ffc15af at /dev/vda
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.policy [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG os_brick.utils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e4679-ab34-45f6-b5b6-5621d223db4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef3d866-2837-49cd-87d5-5a590501ddd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[760c1675-f165-4cb1-acf1-4087248cc25b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ef5878-f19b-4116-bd99-0e923ff8b843]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:07:11 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:07:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a4da84-c02e-4816-8a2d-cade63c7670c]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG os_brick.utils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:07:11 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updating existing volume attachment record: d492b128-4e5b-4bd3-9129-b07354d51882 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:07:12 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Successfully created port: ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:07:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Successfully updated port: ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquired lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received event network-changed-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG nova.compute.manager [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Refreshing instance network info cache due to event network-changed-ef166576-430e-47da-b169-915c4a0cd97c. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] Acquiring lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updating instance_info_cache with network_info: [{"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Releasing lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Instance network_info: |[{"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] Acquired lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:07:13 user nova-compute[71308]: DEBUG nova.network.neutron [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Refreshing network info cache for port ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:07:14 user nova-compute[71308]: DEBUG nova.network.neutron [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updated VIF entry in instance network info cache for port ef166576-430e-47da-b169-915c4a0cd97c. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:07:14 user nova-compute[71308]: DEBUG nova.network.neutron [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updating instance_info_cache with network_info: [{"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:07:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-aaeed17b-f511-42f7-acf1-6a556cb25c5a req-723d3108-7b1a-4d99-baf9-bed3ae803276 service nova] Releasing lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:15 user nova-compute[71308]: INFO nova.compute.manager [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Unshelving
Apr 14 19:07:15 user nova-compute[71308]: INFO nova.virt.block_device [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Booting with volume 732c36bf-d3d1-437c-91f5-710fea1de62b at /dev/vdc
Apr 14 19:07:15 user nova-compute[71308]: DEBUG os_brick.utils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa00b84a-1483-4320-b282-d17258b7a7aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ebb106-3d20-48e1-8a73-95e30b493428]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf8e316-e9e2-437e-bc59-39938d8d37d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b154c9e-6856-4f74-ab5b-450f1545acc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:07:15 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:07:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[14864c77-b35d-4516-8ae6-fc48b82bd62d]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG os_brick.utils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:07:15 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating existing volume attachment record: 3dfa18cf-a588-4cfd-9102-4e2fb5056d14 {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:07:16 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Creating image(s)
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Ensure instance console log exists: /opt/stack/data/nova/instances/935022b4-4ba7-4b34-a758-a00081240b4c/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Start _get_guest_xml network_info=[{"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'd492b128-4e5b-4bd3-9129-b07354d51882', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXLsZHeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '935022b4-4ba7-4b34-a758-a00081240b4c', 'attached_at': '', 'detached_at': '', 'volume_id': '126e30a2-deeb-433e-a8b5-e9970ffc15af', 'serial': '126e30a2-deeb-433e-a8b5-e9970ffc15af'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:07:16 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:07:16 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXLsZHeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:07:16 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:07:16 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:07:16 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec555f28-f9f6-4750-8a41-cc50b5a74328]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:07:16 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f6b582-ee2a-43d9-bcf5-41647a2f27a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af] added
Apr 14 19:07:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc4c7bb-6d63-4fc1-8977-014ddf3e41f8]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7447325-873a-49f2-9109-16b3efeafa9e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXLsZHeV {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXLsZHeV" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9ca966-89ef-4996-93d3-2535c0e72ef2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXLsZHeV'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[447fae59-a04e-4854-81fb-71421e07efdb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e176e8f8-924f-4af5-8213-81684107c433]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:16 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:07:16 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[63583821-c984-423a-8080-e1f6c640c0b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260]
Apr 14 19:07:17 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260] successful.
Apr 14 19:07:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad15c941-d99f-4130-a557-c72828de9db0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dd9a8c-0234-4056-b5a3-66a23c1a5304]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:17 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:07:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:17 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:07:17 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6c7dfa-e15e-4fe9-b432-7852df223a9f]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXLsZHeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26537313064393666', 'path': '/dev/sdc'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537313064393666', 'path': '/dev/sdc'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1288950807',display_name='tempest-TestVolumeBootPattern-server-1288950807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1288950807',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg==',key_name='tempest-TestVolumeBootPattern-875294368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-r456055f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:07:12Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=935022b4-4ba7-4b34-a758-a00081240b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:51:29,bridge_name='br-int',has_traffic_filtering=True,id=ef166576-430e-47da-b169-915c4a0cd97c,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef166576-43') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'pci_devices' on Instance uuid 935022b4-4ba7-4b34-a758-a00081240b4c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:07:18 user nova-compute[71308]:   <uuid>935022b4-4ba7-4b34-a758-a00081240b4c</uuid>
Apr 14 19:07:18 user nova-compute[71308]:   <name>instance-00000029</name>
Apr 14 19:07:18 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:07:18 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:07:18 user nova-compute[71308]:   <metadata>
Apr 14 19:07:18 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:07:18 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:07:18 user nova-compute[71308]:       <nova:name>tempest-TestVolumeBootPattern-server-1288950807</nova:name>
Apr 14 19:07:18 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:07:16</nova:creationTime>
Apr 14 19:07:18 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:07:18 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:07:18 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:07:18 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:07:18 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:07:18 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:07:18 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:07:18 user nova-compute[71308]:       <nova:owner>
Apr 14 19:07:18 user nova-compute[71308]:         <nova:user uuid="fc3bed70703a49c8bdec2f50193c7f70">tempest-TestVolumeBootPattern-1560263906-project-member</nova:user>
Apr 14 19:07:18 user nova-compute[71308]:         <nova:project uuid="72d2bf68325a4a18934a8403571c24bb">tempest-TestVolumeBootPattern-1560263906</nova:project>
Apr 14 19:07:18 user nova-compute[71308]:       </nova:owner>
Apr 14 19:07:18 user nova-compute[71308]:       <nova:ports>
Apr 14 19:07:18 user nova-compute[71308]:         <nova:port uuid="ef166576-430e-47da-b169-915c4a0cd97c">
Apr 14 19:07:18 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 19:07:18 user nova-compute[71308]:         </nova:port>
Apr 14 19:07:18 user nova-compute[71308]:       </nova:ports>
Apr 14 19:07:18 user nova-compute[71308]:     </nova:instance>
Apr 14 19:07:18 user nova-compute[71308]:   </metadata>
Apr 14 19:07:18 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:07:18 user nova-compute[71308]:     <system>
Apr 14 19:07:18 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:07:18 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:07:18 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:07:18 user nova-compute[71308]:       <entry name="serial">935022b4-4ba7-4b34-a758-a00081240b4c</entry>
Apr 14 19:07:18 user nova-compute[71308]:       <entry name="uuid">935022b4-4ba7-4b34-a758-a00081240b4c</entry>
Apr 14 19:07:18 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:07:18 user nova-compute[71308]:     </system>
Apr 14 19:07:18 user nova-compute[71308]:   </sysinfo>
Apr 14 19:07:18 user nova-compute[71308]:   <os>
Apr 14 19:07:18 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:07:18 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:07:18 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:07:18 user nova-compute[71308]:   </os>
Apr 14 19:07:18 user nova-compute[71308]:   <features>
Apr 14 19:07:18 user nova-compute[71308]:     <acpi/>
Apr 14 19:07:18 user nova-compute[71308]:     <apic/>
Apr 14 19:07:18 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:07:18 user nova-compute[71308]:   </features>
Apr 14 19:07:18 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:07:18 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:07:18 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:07:18 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:07:18 user nova-compute[71308]:   </clock>
Apr 14 19:07:18 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:07:18 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:07:18 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:07:18 user nova-compute[71308]:   </cpu>
Apr 14 19:07:18 user nova-compute[71308]:   <devices>
Apr 14 19:07:18 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 19:07:18 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:07:18 user nova-compute[71308]:       <source dev="/dev/sdc"/>
Apr 14 19:07:18 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:07:18 user nova-compute[71308]:       <serial>126e30a2-deeb-433e-a8b5-e9970ffc15af</serial>
Apr 14 19:07:18 user nova-compute[71308]:     </disk>
Apr 14 19:07:18 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:07:18 user nova-compute[71308]:       <mac address="fa:16:3e:e7:51:29"/>
Apr 14 19:07:18 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:07:18 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:07:18 user nova-compute[71308]:       <target dev="tapef166576-43"/>
Apr 14 19:07:18 user nova-compute[71308]:     </interface>
Apr 14 19:07:18 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:07:18 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/935022b4-4ba7-4b34-a758-a00081240b4c/console.log" append="off"/>
Apr 14 19:07:18 user nova-compute[71308]:     </serial>
Apr 14 19:07:18 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:07:18 user nova-compute[71308]:     <video>
Apr 14 19:07:18 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:07:18 user nova-compute[71308]:     </video>
Apr 14 19:07:18 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:07:18 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:07:18 user nova-compute[71308]:     </rng>
Apr 14 19:07:18 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:07:18 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:07:18 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:07:18 user nova-compute[71308]:     </memballoon>
Apr 14 19:07:18 user nova-compute[71308]:   </devices>
Apr 14 19:07:18 user nova-compute[71308]: </domain>
Apr 14 19:07:18 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1288950807',display_name='tempest-TestVolumeBootPattern-server-1288950807',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1288950807',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg==',key_name='tempest-TestVolumeBootPattern-875294368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-r456055f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:07:12Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=935022b4-4ba7-4b34-a758-a00081240b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:51:29,bridge_name='br-int',has_traffic_filtering=True,id=ef166576-430e-47da-b169-915c4a0cd97c,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef166576-43') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG os_vif [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:51:29,bridge_name='br-int',has_traffic_filtering=True,id=ef166576-430e-47da-b169-915c4a0cd97c,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef166576-43') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef166576-43, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef166576-43, col_values=(('external_ids', {'iface-id': 'ef166576-430e-47da-b169-915c4a0cd97c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:51:29', 'vm-uuid': '935022b4-4ba7-4b34-a758-a00081240b4c'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:18 user nova-compute[71308]: INFO os_vif [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:51:29,bridge_name='br-int',has_traffic_filtering=True,id=ef166576-430e-47da-b169-915c4a0cd97c,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef166576-43')
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No VIF found with MAC fa:16:3e:e7:51:29, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:19 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:07:19 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8227MB free_disk=26.296672821044922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 1d305ab4-1813-4728-a01c-287e521a05ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 46d51513-1995-43c5-976a-40789ae575f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a9379580-fd2f-4468-9ed3-7109735195be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 935022b4-4ba7-4b34-a758-a00081240b4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing inventories for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating ProviderTree inventory for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating inventory in ProviderTree for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 19:07:19 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing aggregate associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, aggregates: None {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing trait associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.894s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received event network-vif-plugged-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] Acquiring lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:20 user nova-compute[71308]: DEBUG nova.compute.manager [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] No waiting events found dispatching network-vif-plugged-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:07:20 user nova-compute[71308]: WARNING nova.compute.manager [req-ae953f0e-0ed7-4232-861c-095909ac072c req-08cb7ffb-0897-423a-a4db-671590db662d service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received unexpected event network-vif-plugged-ef166576-430e-47da-b169-915c4a0cd97c for instance with vm_state building and task_state spawning.
Apr 14 19:07:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'pci_requests' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'numa_topology' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:07:21 user nova-compute[71308]: INFO nova.compute.claims [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Claim successful on node user
Apr 14 19:07:21 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:21 user nova-compute[71308]: INFO nova.network.neutron [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating port fef01e15-9070-4b0b-ba18-0b9540774cb9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 19:07:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] There are 0 instances to clean {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499242.0888796, 935022b4-4ba7-4b34-a758-a00081240b4c => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:07:22 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] VM Resumed (Lifecycle Event)
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:22 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Instance spawned successfully.
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquired lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:22 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499242.0924258, 935022b4-4ba7-4b34-a758-a00081240b4c => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:07:22 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] VM Started (Lifecycle Event)
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:07:22 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:07:22 user nova-compute[71308]: INFO nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Took 5.53 seconds to spawn the instance on the hypervisor.
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:22 user nova-compute[71308]: INFO nova.compute.manager [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Took 11.08 seconds to build instance.
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8000ed5f-dfe6-43ae-b224-8e3035799e5b tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "935022b4-4ba7-4b34-a758-a00081240b4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.177s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.network.neutron [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating instance_info_cache with network_info: [{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Releasing lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:07:22 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Creating image(s)
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'trusted_certs' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "0faece89349fca796d0dd3ead439e04a4691105a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "0faece89349fca796d0dd3ead439e04a4691105a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received event network-vif-plugged-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Acquiring lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] No waiting events found dispatching network-vif-plugged-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:07:22 user nova-compute[71308]: WARNING nova.compute.manager [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received unexpected event network-vif-plugged-ef166576-430e-47da-b169-915c4a0cd97c for instance with vm_state active and task_state None.
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-changed-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.compute.manager [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Refreshing instance network info cache due to event network-changed-fef01e15-9070-4b0b-ba18-0b9540774cb9. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Acquiring lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Acquired lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:07:22 user nova-compute[71308]: DEBUG nova.network.neutron [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Refreshing network info cache for port fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a.part --force-share --output=json" returned: 0 in 0.168s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG nova.virt.images [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] d0253af1-1f43-4136-a071-acd72ccaafed was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a.part /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a.part /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a.converted" returned: 0 in 0.191s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "0faece89349fca796d0dd3ead439e04a4691105a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.297s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:07:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updated VIF entry in instance network info cache for port fef01e15-9070-4b0b-ba18-0b9540774cb9. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG nova.network.neutron [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating instance_info_cache with network_info: [{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f613b68-6d09-4a6d-a4bd-0f4ebe1c5777 req-38e34ba5-5be8-47e6-9185-c094bd6f10c4 service nova] Releasing lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:07:24 user nova-compute[71308]: INFO nova.compute.manager [None req-54afe4c7-7b80-42cb-beef-dde85c0c2414 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Get console output
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a --force-share --output=json" returned: 0 in 0.159s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "0faece89349fca796d0dd3ead439e04a4691105a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "0faece89349fca796d0dd3ead439e04a4691105a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a --force-share --output=json" returned: 0 in 0.179s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a,backing_fmt=raw /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:24 user nova-compute[71308]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a,backing_fmt=raw /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk 1073741824" returned: 0 in 0.051s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "0faece89349fca796d0dd3ead439e04a4691105a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0faece89349fca796d0dd3ead439e04a4691105a --force-share --output=json" returned: 0 in 0.184s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'migration_context' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Rebasing disk image.
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 -F raw /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "1d305ab4-1813-4728-a01c-287e521a05ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:25 user nova-compute[71308]: INFO nova.compute.manager [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Terminating instance
Apr 14 19:07:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:07:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-unplugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-unplugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-4828be5d-4e63-4d9f-9e54-4ee97a940694 req-70abb5a7-44e1-43db-856d-18652ff35af0 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-unplugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:07:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Instance destroyed successfully.
Apr 14 19:07:26 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lazy-loading 'resources' on Instance uuid 1d305ab4-1813-4728-a01c-287e521a05ec {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2104481497',display_name='tempest-ServerRescueNegativeTestJSON-server-2104481497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2104481497',id=16,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:55:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e60e8abd123e414f847c68ba72894689',ramdisk_id='',reservation_id='r-8u3ne6pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174646715',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174646715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:57:06Z,user_data=None,user_id='c8713ed85ffb4446847f5ded4bc2e399',uuid=1d305ab4-1813-4728-a01c-287e521a05ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converting VIF {"id": "d07ff847-3983-4b35-af36-fbd845ede770", "address": "fa:16:3e:de:75:e0", "network": {"id": "fc7fb9bf-ad17-4427-9165-d2b68830357a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-495360071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e60e8abd123e414f847c68ba72894689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd07ff847-39", "ovs_interfaceid": "d07ff847-3983-4b35-af36-fbd845ede770", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=d07ff847-3983-4b35-af36-fbd845ede770,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07ff847-39') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG os_vif [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=d07ff847-3983-4b35-af36-fbd845ede770,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07ff847-39') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd07ff847-39, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:07:26 user nova-compute[71308]: INFO os_vif [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:75:e0,bridge_name='br-int',has_traffic_filtering=True,id=d07ff847-3983-4b35-af36-fbd845ede770,network=Network(fc7fb9bf-ad17-4427-9165-d2b68830357a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd07ff847-39')
Apr 14 19:07:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Deleting instance files /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec_del
Apr 14 19:07:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Deletion of /opt/stack/data/nova/instances/1d305ab4-1813-4728-a01c-287e521a05ec_del complete
Apr 14 19:07:26 user nova-compute[71308]: INFO nova.compute.manager [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Took 1.02 seconds to destroy the instance on the hypervisor.
Apr 14 19:07:26 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:07:26 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 -F raw /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk" returned: 0 in 2.350s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Ensure instance console log exists: /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Start _get_guest_xml network_info=[{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='700594478639ab438aeb7f3d88115784',container_format='bare',created_at=2023-04-14T19:05:23Z,direct_url=<?>,disk_format='qcow2',id=d0253af1-1f43-4136-a071-acd72ccaafed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1127447025-shelved',owner='ebb0956418bd462c84e1392a74b5ae2e',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T19:05:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': '3dfa18cf-a588-4cfd-9102-4e2fb5056d14', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faYycBIN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '179270ef-7866-4ee7-af13-ec3ea5e7525a', 'attached_at': '', 'detached_at': '', 'volume_id': '732c36bf-d3d1-437c-91f5-710fea1de62b', 'serial': '732c36bf-d3d1-437c-91f5-710fea1de62b'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:07:27 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:07:27 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='700594478639ab438aeb7f3d88115784',container_format='bare',created_at=2023-04-14T19:05:23Z,direct_url=<?>,disk_format='qcow2',id=d0253af1-1f43-4136-a071-acd72ccaafed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1127447025-shelved',owner='ebb0956418bd462c84e1392a74b5ae2e',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T19:05:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'vcpu_model' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faYycBIN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:07:27 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:07:27 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:07:27 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9606c3c4-7c22-47f1-b1b7-acf4dc94ef0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:07:27 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d62ca8-dd57-4a20-ad69-2ab33876b0a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b] added
Apr 14 19:07:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fa78d1-69d5-4921-a5c2-4ab47dc54778]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f45558-e0f1-4f5a-8f35-0cb23d62dfcb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v faYycBIN {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v faYycBIN" returned: 0 in 0.030s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[797ef625-fa2c-4d4a-9a26-a779e5ab32b3]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'faYycBIN'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-deleted-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:27 user nova-compute[71308]: INFO nova.compute.manager [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Neutron deleted interface d07ff847-3983-4b35-af36-fbd845ede770; detaching it from the instance and deleting it from the info cache
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.network.neutron [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-09de6ccc-78b1-484d-a8da-53fa75f3205a req-1568034a-6e6c-4b01-85b8-ed29800a1ba2 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Detach interface failed, port_id=d07ff847-3983-4b35-af36-fbd845ede770, reason: Instance 1d305ab4-1813-4728-a01c-287e521a05ec could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.122s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6164c-63b8-4fb4-ba44-0e6903ea7234]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Took 0.87 seconds to deallocate network for instance.
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3638550-dfc6-4caf-b09e-d87b5f36dec4]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:27 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:07:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:27 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:07:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eefee6b-9f7d-402d-b63e-e2565368cb0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b, portal: 172.16.0.220,3260]
Apr 14 19:07:27 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b, portal: 172.16.0.220,3260] successful.
Apr 14 19:07:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[81679204-a4f4-4ed6-b6a9-80f3aac869d6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1bab45-5589-48a4-9945-5ca06a41ca5f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:27 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:07:27 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:07:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:07:27 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:07:27 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:07:27 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c21bf1-91f1-4a9a-bd53-46c483105b74]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faYycBIN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:27 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Deleted allocations for instance 1d305ab4-1813-4728-a01c-287e521a05ec
Apr 14 19:07:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7fac80b4-8084-4dee-8a1d-64f1ea1b9cfb tempest-ServerRescueNegativeTestJSON-1174646715 tempest-ServerRescueNegativeTestJSON-1174646715-project-member] Lock "1d305ab4-1813-4728-a01c-287e521a05ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] Acquiring lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] Lock "1d305ab4-1813-4728-a01c-287e521a05ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.compute.manager [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] No waiting events found dispatching network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:07:28 user nova-compute[71308]: WARNING nova.compute.manager [req-364fd9f1-4597-432b-bb38-6a590c747a75 req-ceac89e6-7de5-44d0-955b-b8f4bb3d94d6 service nova] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Received unexpected event network-vif-plugged-d07ff847-3983-4b35-af36-fbd845ede770 for instance with vm_state deleted and task_state None.
Apr 14 19:07:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.500s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] <== connect_volume: return (1503ms) {'type': 'block', 'scsi_wwn': '23238326264356339', 'path': '/dev/sdd'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238326264356339', 'path': '/dev/sdd'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T19:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1127447025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1127447025',id=38,image_ref='d0253af1-1f43-4136-a071-acd72ccaafed',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1365704596',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-e2gxcjgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member',shelved_at='2023-04-14T19:05:26.650167',shelved_host='user',shelved_image_id='d0253af1-1f43-4136-a071-acd72ccaafed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=179270ef-7866-4ee7-af13-ec3ea5e7525a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'pci_devices' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:07:28 user nova-compute[71308]:   <uuid>179270ef-7866-4ee7-af13-ec3ea5e7525a</uuid>
Apr 14 19:07:28 user nova-compute[71308]:   <name>instance-00000026</name>
Apr 14 19:07:28 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:07:28 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:07:28 user nova-compute[71308]:   <metadata>
Apr 14 19:07:28 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:07:28 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:07:28 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1127447025</nova:name>
Apr 14 19:07:28 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:07:27</nova:creationTime>
Apr 14 19:07:28 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:07:28 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:07:28 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:07:28 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:07:28 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:07:28 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:07:28 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:07:28 user nova-compute[71308]:       <nova:owner>
Apr 14 19:07:28 user nova-compute[71308]:         <nova:user uuid="716e5499c6eb483e9c88fd25606018d9">tempest-AttachVolumeShelveTestJSON-1405261713-project-member</nova:user>
Apr 14 19:07:28 user nova-compute[71308]:         <nova:project uuid="ebb0956418bd462c84e1392a74b5ae2e">tempest-AttachVolumeShelveTestJSON-1405261713</nova:project>
Apr 14 19:07:28 user nova-compute[71308]:       </nova:owner>
Apr 14 19:07:28 user nova-compute[71308]:       <nova:root type="image" uuid="d0253af1-1f43-4136-a071-acd72ccaafed"/>
Apr 14 19:07:28 user nova-compute[71308]:       <nova:ports>
Apr 14 19:07:28 user nova-compute[71308]:         <nova:port uuid="fef01e15-9070-4b0b-ba18-0b9540774cb9">
Apr 14 19:07:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 19:07:28 user nova-compute[71308]:         </nova:port>
Apr 14 19:07:28 user nova-compute[71308]:       </nova:ports>
Apr 14 19:07:28 user nova-compute[71308]:     </nova:instance>
Apr 14 19:07:28 user nova-compute[71308]:   </metadata>
Apr 14 19:07:28 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:07:28 user nova-compute[71308]:     <system>
Apr 14 19:07:28 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:07:28 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:07:28 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:07:28 user nova-compute[71308]:       <entry name="serial">179270ef-7866-4ee7-af13-ec3ea5e7525a</entry>
Apr 14 19:07:28 user nova-compute[71308]:       <entry name="uuid">179270ef-7866-4ee7-af13-ec3ea5e7525a</entry>
Apr 14 19:07:28 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:07:28 user nova-compute[71308]:     </system>
Apr 14 19:07:28 user nova-compute[71308]:   </sysinfo>
Apr 14 19:07:28 user nova-compute[71308]:   <os>
Apr 14 19:07:28 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:07:28 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:07:28 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:07:28 user nova-compute[71308]:   </os>
Apr 14 19:07:28 user nova-compute[71308]:   <features>
Apr 14 19:07:28 user nova-compute[71308]:     <acpi/>
Apr 14 19:07:28 user nova-compute[71308]:     <apic/>
Apr 14 19:07:28 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:07:28 user nova-compute[71308]:   </features>
Apr 14 19:07:28 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:07:28 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:07:28 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:07:28 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:07:28 user nova-compute[71308]:   </clock>
Apr 14 19:07:28 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:07:28 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:07:28 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:07:28 user nova-compute[71308]:   </cpu>
Apr 14 19:07:28 user nova-compute[71308]:   <devices>
Apr 14 19:07:28 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:07:28 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:07:28 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk"/>
Apr 14 19:07:28 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:07:28 user nova-compute[71308]:     </disk>
Apr 14 19:07:28 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 19:07:28 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:07:28 user nova-compute[71308]:       <source dev="/dev/sdd"/>
Apr 14 19:07:28 user nova-compute[71308]:       <target dev="vdc" bus="virtio"/>
Apr 14 19:07:28 user nova-compute[71308]:       <serial>732c36bf-d3d1-437c-91f5-710fea1de62b</serial>
Apr 14 19:07:28 user nova-compute[71308]:     </disk>
Apr 14 19:07:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:07:28 user nova-compute[71308]:       <mac address="fa:16:3e:f5:25:ae"/>
Apr 14 19:07:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:07:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:07:28 user nova-compute[71308]:       <target dev="tapfef01e15-90"/>
Apr 14 19:07:28 user nova-compute[71308]:     </interface>
Apr 14 19:07:28 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:07:28 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/console.log" append="off"/>
Apr 14 19:07:28 user nova-compute[71308]:     </serial>
Apr 14 19:07:28 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:07:28 user nova-compute[71308]:     <video>
Apr 14 19:07:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:07:28 user nova-compute[71308]:     </video>
Apr 14 19:07:28 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:07:28 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:07:28 user nova-compute[71308]:     </rng>
Apr 14 19:07:28 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:07:28 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:07:28 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:07:28 user nova-compute[71308]:     </memballoon>
Apr 14 19:07:28 user nova-compute[71308]:   </devices>
Apr 14 19:07:28 user nova-compute[71308]: </domain>
Apr 14 19:07:28 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T19:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1127447025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1127447025',id=38,image_ref='d0253af1-1f43-4136-a071-acd72ccaafed',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1365704596',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:03:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-e2gxcjgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member',shelved_at='2023-04-14T19:05:26.650167',shelved_host='user',shelved_image_id='d0253af1-1f43-4136-a071-acd72ccaafed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=179270ef-7866-4ee7-af13-ec3ea5e7525a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG os_vif [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfef01e15-90, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfef01e15-90, col_values=(('external_ids', {'iface-id': 'fef01e15-9070-4b0b-ba18-0b9540774cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:25:ae', 'vm-uuid': '179270ef-7866-4ee7-af13-ec3ea5e7525a'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:28 user nova-compute[71308]: INFO os_vif [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90')
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] No VIF found with MAC fa:16:3e:f5:25:ae, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:07:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:29 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:07:30 user nova-compute[71308]: WARNING nova.compute.manager [req-5ec95c2c-4789-4c1a-bda3-5cb3afa52983 req-a48295f2-feb5-40e4-b455-34e104109f9c service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 19:07:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499252.2719455, 179270ef-7866-4ee7-af13-ec3ea5e7525a => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:07:32 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] VM Resumed (Lifecycle Event)
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:07:32 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance spawned successfully.
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:07:32 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499252.2750943, 179270ef-7866-4ee7-af13-ec3ea5e7525a => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:07:32 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] VM Started (Lifecycle Event)
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:07:32 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:07:32 user nova-compute[71308]: WARNING nova.compute.manager [req-93a7ac43-a881-4622-90a0-d17068810b28 req-642a0ab8-ba14-427a-90e9-6f16b0c3ac57 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 19:07:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc2042dc-c149-43ac-a4ba-3bc28bf424af tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.917s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:34 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:07:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71308) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 19:07:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:38 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:41 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499246.496098, 1d305ab4-1813-4728-a01c-287e521a05ec => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:07:41 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] VM Stopped (Lifecycle Event)
Apr 14 19:07:41 user nova-compute[71308]: DEBUG nova.compute.manager [None req-0fad4e1c-3251-4316-a2b2-411fb7d43f5d None None] [instance: 1d305ab4-1813-4728-a01c-287e521a05ec] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:41 user nova-compute[71308]: DEBUG nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:07:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:41 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:07:41 user nova-compute[71308]: INFO nova.compute.claims [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Claim successful on node user
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.network.neutron [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:07:42 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.policy [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b1b6efb65b541ef992b66d9d06bd03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f71b0490e5a4d3b9300dc510b936a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:07:42 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Creating image(s)
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "/opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "/opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "/opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk 1073741824" returned: 0 in 0.062s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.131s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:07:42 user nova-compute[71308]: DEBUG nova.network.neutron [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Successfully created port: 7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Cannot resize image /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.objects.instance [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lazy-loading 'migration_context' on Instance uuid dab65dfd-f2a1-4631-82a2-70a18f0f33f7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Ensure instance console log exists: /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.network.neutron [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Successfully updated port: 7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "refresh_cache-dab65dfd-f2a1-4631-82a2-70a18f0f33f7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquired lock "refresh_cache-dab65dfd-f2a1-4631-82a2-70a18f0f33f7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.network.neutron [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received event network-changed-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.compute.manager [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Refreshing instance network info cache due to event network-changed-7c974323-9ad0-4786-b46b-27b6d54a612b. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] Acquiring lock "refresh_cache-dab65dfd-f2a1-4631-82a2-70a18f0f33f7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.network.neutron [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG nova.network.neutron [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Updating instance_info_cache with network_info: [{"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:07:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Releasing lock "refresh_cache-dab65dfd-f2a1-4631-82a2-70a18f0f33f7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Instance network_info: |[{"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] Acquired lock "refresh_cache-dab65dfd-f2a1-4631-82a2-70a18f0f33f7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Refreshing network info cache for port 7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Start _get_guest_xml network_info=[{"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:07:44 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:07:44 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-483537759',display_name='tempest-VolumesActionsTest-instance-483537759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-483537759',id=42,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f71b0490e5a4d3b9300dc510b936a44',ramdisk_id='',reservation_id='r-uwxialvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1832164482',owner_user_name='tempest-VolumesActionsTest-1832164482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:07:42Z,user_data=None,user_id='0b1b6efb65b541ef992b66d9d06bd03f',uuid=dab65dfd-f2a1-4631-82a2-70a18f0f33f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converting VIF {"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:3e:16,bridge_name='br-int',has_traffic_filtering=True,id=7c974323-9ad0-4786-b46b-27b6d54a612b,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c974323-9a') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.objects.instance [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lazy-loading 'pci_devices' on Instance uuid dab65dfd-f2a1-4631-82a2-70a18f0f33f7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:07:44 user nova-compute[71308]:   <uuid>dab65dfd-f2a1-4631-82a2-70a18f0f33f7</uuid>
Apr 14 19:07:44 user nova-compute[71308]:   <name>instance-0000002a</name>
Apr 14 19:07:44 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:07:44 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:07:44 user nova-compute[71308]:   <metadata>
Apr 14 19:07:44 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:07:44 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:07:44 user nova-compute[71308]:       <nova:name>tempest-VolumesActionsTest-instance-483537759</nova:name>
Apr 14 19:07:44 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:07:44</nova:creationTime>
Apr 14 19:07:44 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:07:44 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:07:44 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:07:44 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:07:44 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:07:44 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:07:44 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:07:44 user nova-compute[71308]:       <nova:owner>
Apr 14 19:07:44 user nova-compute[71308]:         <nova:user uuid="0b1b6efb65b541ef992b66d9d06bd03f">tempest-VolumesActionsTest-1832164482-project-member</nova:user>
Apr 14 19:07:44 user nova-compute[71308]:         <nova:project uuid="5f71b0490e5a4d3b9300dc510b936a44">tempest-VolumesActionsTest-1832164482</nova:project>
Apr 14 19:07:44 user nova-compute[71308]:       </nova:owner>
Apr 14 19:07:44 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 19:07:44 user nova-compute[71308]:       <nova:ports>
Apr 14 19:07:44 user nova-compute[71308]:         <nova:port uuid="7c974323-9ad0-4786-b46b-27b6d54a612b">
Apr 14 19:07:44 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 19:07:44 user nova-compute[71308]:         </nova:port>
Apr 14 19:07:44 user nova-compute[71308]:       </nova:ports>
Apr 14 19:07:44 user nova-compute[71308]:     </nova:instance>
Apr 14 19:07:44 user nova-compute[71308]:   </metadata>
Apr 14 19:07:44 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:07:44 user nova-compute[71308]:     <system>
Apr 14 19:07:44 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:07:44 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:07:44 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:07:44 user nova-compute[71308]:       <entry name="serial">dab65dfd-f2a1-4631-82a2-70a18f0f33f7</entry>
Apr 14 19:07:44 user nova-compute[71308]:       <entry name="uuid">dab65dfd-f2a1-4631-82a2-70a18f0f33f7</entry>
Apr 14 19:07:44 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:07:44 user nova-compute[71308]:     </system>
Apr 14 19:07:44 user nova-compute[71308]:   </sysinfo>
Apr 14 19:07:44 user nova-compute[71308]:   <os>
Apr 14 19:07:44 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:07:44 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:07:44 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:07:44 user nova-compute[71308]:   </os>
Apr 14 19:07:44 user nova-compute[71308]:   <features>
Apr 14 19:07:44 user nova-compute[71308]:     <acpi/>
Apr 14 19:07:44 user nova-compute[71308]:     <apic/>
Apr 14 19:07:44 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:07:44 user nova-compute[71308]:   </features>
Apr 14 19:07:44 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:07:44 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:07:44 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:07:44 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:07:44 user nova-compute[71308]:   </clock>
Apr 14 19:07:44 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:07:44 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:07:44 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:07:44 user nova-compute[71308]:   </cpu>
Apr 14 19:07:44 user nova-compute[71308]:   <devices>
Apr 14 19:07:44 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:07:44 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:07:44 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk"/>
Apr 14 19:07:44 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:07:44 user nova-compute[71308]:     </disk>
Apr 14 19:07:44 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:07:44 user nova-compute[71308]:       <mac address="fa:16:3e:28:3e:16"/>
Apr 14 19:07:44 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:07:44 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:07:44 user nova-compute[71308]:       <target dev="tap7c974323-9a"/>
Apr 14 19:07:44 user nova-compute[71308]:     </interface>
Apr 14 19:07:44 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:07:44 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/console.log" append="off"/>
Apr 14 19:07:44 user nova-compute[71308]:     </serial>
Apr 14 19:07:44 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:07:44 user nova-compute[71308]:     <video>
Apr 14 19:07:44 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:07:44 user nova-compute[71308]:     </video>
Apr 14 19:07:44 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:07:44 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:07:44 user nova-compute[71308]:     </rng>
Apr 14 19:07:44 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:07:44 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:07:44 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:07:44 user nova-compute[71308]:     </memballoon>
Apr 14 19:07:44 user nova-compute[71308]:   </devices>
Apr 14 19:07:44 user nova-compute[71308]: </domain>
Apr 14 19:07:44 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-483537759',display_name='tempest-VolumesActionsTest-instance-483537759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-483537759',id=42,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f71b0490e5a4d3b9300dc510b936a44',ramdisk_id='',reservation_id='r-uwxialvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1832164482',owner_user_name='tempest-VolumesActionsTest-1832164482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:07:42Z,user_data=None,user_id='0b1b6efb65b541ef992b66d9d06bd03f',uuid=dab65dfd-f2a1-4631-82a2-70a18f0f33f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converting VIF {"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:3e:16,bridge_name='br-int',has_traffic_filtering=True,id=7c974323-9ad0-4786-b46b-27b6d54a612b,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c974323-9a') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG os_vif [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:3e:16,bridge_name='br-int',has_traffic_filtering=True,id=7c974323-9ad0-4786-b46b-27b6d54a612b,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c974323-9a') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c974323-9a, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c974323-9a, col_values=(('external_ids', {'iface-id': '7c974323-9ad0-4786-b46b-27b6d54a612b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:3e:16', 'vm-uuid': 'dab65dfd-f2a1-4631-82a2-70a18f0f33f7'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:44 user nova-compute[71308]: INFO os_vif [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:3e:16,bridge_name='br-int',has_traffic_filtering=True,id=7c974323-9ad0-4786-b46b-27b6d54a612b,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c974323-9a')
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] No VIF found with MAC fa:16:3e:28:3e:16, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Updated VIF entry in instance network info cache for port 7c974323-9ad0-4786-b46b-27b6d54a612b. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG nova.network.neutron [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Updating instance_info_cache with network_info: [{"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:07:44 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-012adb01-e625-42d1-b5ff-b37d1227653e req-83bf3589-1e7a-49ea-bfab-0f161b1d6827 service nova] Releasing lock "refresh_cache-dab65dfd-f2a1-4631-82a2-70a18f0f33f7" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:07:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received event network-vif-plugged-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] Acquiring lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:45 user nova-compute[71308]: DEBUG nova.compute.manager [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] No waiting events found dispatching network-vif-plugged-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:07:45 user nova-compute[71308]: WARNING nova.compute.manager [req-4086aedf-45af-450b-96c4-713d64236d40 req-9ebcee94-221c-4c74-a0be-a3078a729ad0 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received unexpected event network-vif-plugged-7c974323-9ad0-4786-b46b-27b6d54a612b for instance with vm_state building and task_state spawning.
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499267.648581, dab65dfd-f2a1-4631-82a2-70a18f0f33f7 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:07:47 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] VM Resumed (Lifecycle Event)
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:07:47 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Instance spawned successfully.
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:07:47 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499267.652436, dab65dfd-f2a1-4631-82a2-70a18f0f33f7 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:07:47 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] VM Started (Lifecycle Event)
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:07:47 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:07:47 user nova-compute[71308]: INFO nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Took 5.40 seconds to spawn the instance on the hypervisor.
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:07:47 user nova-compute[71308]: INFO nova.compute.manager [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Took 6.02 seconds to build instance.
Apr 14 19:07:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-af7ed3d1-d3b0-436d-a13a-99a4bf397d2c tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.110s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received event network-vif-plugged-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] Acquiring lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:07:47 user nova-compute[71308]: DEBUG nova.compute.manager [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] No waiting events found dispatching network-vif-plugged-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:07:47 user nova-compute[71308]: WARNING nova.compute.manager [req-f8bd7a9a-c6ce-4a21-a6bf-83b338b07fb1 req-d076580b-f9cb-443c-b90a-6c28b83099cb service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received unexpected event network-vif-plugged-7c974323-9ad0-4786-b46b-27b6d54a612b for instance with vm_state active and task_state None.
Apr 14 19:07:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:58 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:07:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG nova.objects.instance [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:02 user nova-compute[71308]: INFO nova.compute.manager [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attaching volume 181629c0-20ac-42f2-a3c3-25e9feeda169 to /dev/vdb
Apr 14 19:08:02 user nova-compute[71308]: DEBUG os_brick.utils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9a6db8-0507-4e61-b575-396c5d0ac9af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:02 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b906a672-9875-475b-8dad-6f21ca6b084a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8568dccb-e607-4081-bb5b-a8c93d3d36b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[222730ea-9dc3-4e13-bc33-7a5c0f995793]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:08:03 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:08:03 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c90668-aaa2-438f-86ab-befe579c704f]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG os_brick.utils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating existing volume attachment record: 5c7ed825-c309-482d-b89f-e61266c444eb {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:08:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrVqLhdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:08:07 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:08:07 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:08:07 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15d6235-9aa9-4459-8b34-460003ef5c4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:08:07 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2f4c60-c2b0-47a0-a697-0aa6aaa8feee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169] added
Apr 14 19:08:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[227712fe-cdcf-4c0f-a34a-db3c94fa291c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6b2d06-280e-448c-8594-a06598e39bda]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrVqLhdl {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrVqLhdl" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[81511ff1-3499-4c5d-a0b8-28ffdb9d2a44]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrVqLhdl'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d3559a-51f7-495f-9732-7fae85c72bf0]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fd7288-7fa2-416a-9c4e-fc073074e0d5]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:08:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:08:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[582aecfe-f94e-40ec-a9f8-bb8c69517fda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169, portal: 172.16.0.220,3260]
Apr 14 19:08:07 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169, portal: 172.16.0.220,3260] successful.
Apr 14 19:08:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ffce2-8c03-4d02-8114-fe35dae40248]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e702f33-fe67-44d4-9f07-db1d6f02790f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 (non-flash)
Apr 14 19:08:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:08:07 user nova-compute[71308]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 (non-flash)
Apr 14 19:08:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d654b52-edaf-4627-9c9c-523abbf1c261]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:08:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrVqLhdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:08:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:08:08 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23565346439373966', 'path': '/dev/sde'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:08:08 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565346439373966', 'path': '/dev/sde'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:08:09 user nova-compute[71308]: DEBUG nova.objects.instance [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:08:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 19:08:09 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:08:09 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 19:08:09 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:08:09 user nova-compute[71308]:   <serial>181629c0-20ac-42f2-a3c3-25e9feeda169</serial>
Apr 14 19:08:09 user nova-compute[71308]: </disk>
Apr 14 19:08:09 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 19:08:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:08:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:08:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No VIF found with MAC fa:16:3e:9f:62:f6, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:08:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-798e88e2-1f58-400f-82e6-207ea21ed761 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.649s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:09 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:11 user nova-compute[71308]: INFO nova.compute.manager [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Detaching volume 181629c0-20ac-42f2-a3c3-25e9feeda169
Apr 14 19:08:11 user nova-compute[71308]: INFO nova.virt.block_device [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attempting to driver detach volume 181629c0-20ac-42f2-a3c3-25e9feeda169 from mountpoint /dev/vdb
Apr 14 19:08:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Attempting to detach device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:08:11 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:08:11 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 19:08:11 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:08:11 user nova-compute[71308]:   <serial>181629c0-20ac-42f2-a3c3-25e9feeda169</serial>
Apr 14 19:08:11 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:08:11 user nova-compute[71308]: </disk>
Apr 14 19:08:11 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:08:11 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully detached device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the persistent domain config.
Apr 14 19:08:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9379580-fd2f-4468-9ed3-7109735195be from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:08:11 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:08:11 user nova-compute[71308]:   <source dev="/dev/sde"/>
Apr 14 19:08:11 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:08:11 user nova-compute[71308]:   <serial>181629c0-20ac-42f2-a3c3-25e9feeda169</serial>
Apr 14 19:08:11 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:08:11 user nova-compute[71308]: </disk>
Apr 14 19:08:11 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681499291.6807468, a9379580-fd2f-4468-9ed3-7109735195be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 19:08:11 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully detached device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the live domain config.
Apr 14 19:08:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrVqLhdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:08:11 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f66f38-e506-47a9-bf11-3c093e9ab5c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:08:11 user nova-compute[71308]: No targets found.
Apr 14 19:08:11 user nova-compute[71308]: iSNS:
Apr 14 19:08:11 user nova-compute[71308]: No targets found.
Apr 14 19:08:11 user nova-compute[71308]: STATIC:
Apr 14 19:08:11 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:08:11 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:08:11 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:08:11 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:08:11 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:08:11 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:08:11 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169
Apr 14 19:08:11 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:08:11 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:08:11 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b
Apr 14 19:08:11 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:08:11 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:08:11 user nova-compute[71308]: FIRMWARE:
Apr 14 19:08:11 user nova-compute[71308]: No targets found.
Apr 14 19:08:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:08:11 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:08:11 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[415d8711-13b9-4f56-b487-2cf927330e78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6357ab-3781-464d-86f6-d4f8f5920e33]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:08:11 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:08:11 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:08:11 user nova-compute[71308]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 (non-flash)
Apr 14 19:08:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:08:11 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:08:11 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:08:11 user nova-compute[71308]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 (non-flash)
Apr 14 19:08:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f226c2fa830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169'): ({'sde'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Removing single pathed devices sde {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[76947c66-3a2d-40d8-98e5-9678dc06bab9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e5006-1711-4bf3-8764-b8569805272f]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Flushing IO for device /dev/sde {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d375303-70ca-44f9-b07d-dd89cf87c280]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00dcc23-6363-4c68-8da9-4ec848235baf]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] SCSI volumes sde have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[091be955-ba10-487b-94bc-37f73b6e54fe]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b30f0b-f618-4269-8385-d4735e4bbbd1]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169, portal: 172.16.0.220,3260]
Apr 14 19:08:11 user nova-compute[71308]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169, portal: 172.16.0.220,3260] successful.
Apr 14 19:08:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181629c0-20ac-42f2-a3c3-25e9feeda169 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c293a69-f259-4e94-8212-b95f1a06c155]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== disconnect_volume: return (284ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:08:11 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:08:12 user nova-compute[71308]: DEBUG nova.objects.instance [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:08:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-c1a92122-4dc2-4074-b981-d5213b5b9656 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:12 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:08:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:18 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:08:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:08:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=7954MB free_disk=26.26862335205078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 46d51513-1995-43c5-976a-40789ae575f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a9379580-fd2f-4468-9ed3-7109735195be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 935022b4-4ba7-4b34-a758-a00081240b4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:08:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:08:21 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:08:21 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:08:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:08:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:08:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lazy-loading 'info_cache' on Instance uuid 46d51513-1995-43c5-976a-40789ae575f1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updating instance_info_cache with network_info: [{"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-46d51513-1995-43c5-976a-40789ae575f1" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:25 user nova-compute[71308]: INFO nova.compute.manager [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Terminating instance
Apr 14 19:08:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-unplugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] No waiting events found dispatching network-vif-unplugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-d1981819-9d88-49a4-b5a9-78ad71e07043 req-9321e2f6-35e2-4d46-8497-aaef51c64ed6 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-unplugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:08:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Instance destroyed successfully.
Apr 14 19:08:25 user nova-compute[71308]: DEBUG nova.objects.instance [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'resources' on Instance uuid d4a54fb1-bd66-42f5-9f8c-9fb40470f468 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1675664043',display_name='tempest-ServerActionsTestJSON-server-1675664043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1675664043',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-ghhedf08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:05:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=d4a54fb1-bd66-42f5-9f8c-9fb40470f468,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "address": "fa:16:3e:9c:b6:c8", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbafdaca1-3f", "ovs_interfaceid": "bafdaca1-3fa1-4ec9-93ef-d357c8589ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_vif [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbafdaca1-3f, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:08:25 user nova-compute[71308]: INFO os_vif [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b6:c8,bridge_name='br-int',has_traffic_filtering=True,id=bafdaca1-3fa1-4ec9-93ef-d357c8589ea2,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbafdaca1-3f')
Apr 14 19:08:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFKupJlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:08:25 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0fd477-de58-42eb-8e93-acd69d7b3f57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:08:25 user nova-compute[71308]: No targets found.
Apr 14 19:08:25 user nova-compute[71308]: iSNS:
Apr 14 19:08:25 user nova-compute[71308]: No targets found.
Apr 14 19:08:25 user nova-compute[71308]: STATIC:
Apr 14 19:08:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39
Apr 14 19:08:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:08:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:08:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:08:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:08:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:08:25 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b
Apr 14 19:08:25 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:08:25 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:08:25 user nova-compute[71308]: FIRMWARE:
Apr 14 19:08:25 user nova-compute[71308]: No targets found.
Apr 14 19:08:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:08:25 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:08:25 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e1562-baf8-494c-bf23-f824cde805d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c883815-74a0-4b0e-b2b4-e5d72102d7c9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:08:25 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:08:25 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:08:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 (non-flash)
Apr 14 19:08:25 user nova-compute[71308]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:08:25 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:08:25 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f223035d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[059af4f0-b907-4777-94f1-e4f1b2833950]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[83718e97-14a0-4b42-bb07-8bfc2f188dcb]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc9a6be-f4de-4246-a115-a5497e49d810]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:08:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[6311c132-74ae-4576-ba6e-04d8ef2b8daf]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccde5dc-9c62-42fe-9259-9378b89488a1]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4391827-3735-4306-8efa-aeb05da23266]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260]
Apr 14 19:08:26 user nova-compute[71308]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39, portal: 172.16.0.220,3260] successful.
Apr 14 19:08:26 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4441ca6a-4e8c-45c6-9669-8db66ae94a39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d227e0-16c0-4fb6-b0f9-7bcf51e6db84]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] <== disconnect_volume: return (332ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:08:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Deleting instance files /opt/stack/data/nova/instances/d4a54fb1-bd66-42f5-9f8c-9fb40470f468_del
Apr 14 19:08:26 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Deletion of /opt/stack/data/nova/instances/d4a54fb1-bd66-42f5-9f8c-9fb40470f468_del complete
Apr 14 19:08:26 user nova-compute[71308]: INFO nova.compute.manager [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 19:08:26 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:08:26 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:08:27 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:08:27 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Took 0.91 seconds to deallocate network for instance.
Apr 14 19:08:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-c50ee20b-fc37-4ae0-ab36-e01d3a50baa8 req-cbdf170c-e335-460b-a4cc-37dead1db44e service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-deleted-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:08:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:08:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] Acquiring lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] No waiting events found dispatching network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:08:27 user nova-compute[71308]: WARNING nova.compute.manager [req-b1cb4e50-23ee-4746-8e1e-c851ab534565 req-ed863f3c-5677-4f2c-9149-e8a34b1f5ca4 service nova] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Received unexpected event network-vif-plugged-bafdaca1-3fa1-4ec9-93ef-d357c8589ea2 for instance with vm_state active and task_state deleting.
Apr 14 19:08:27 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:08:27 user nova-compute[71308]: INFO nova.compute.manager [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 19:08:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Deleting volume: 4441ca6a-4e8c-45c6-9669-8db66ae94a39 {{(pid=71308) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 19:08:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:28 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:08:28 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:08:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:28 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Deleted allocations for instance d4a54fb1-bd66-42f5-9f8c-9fb40470f468
Apr 14 19:08:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-5335e5cf-c12f-431e-9e3e-549346e87a19 tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "d4a54fb1-bd66-42f5-9f8c-9fb40470f468" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.810s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:40 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499305.7553647, d4a54fb1-bd66-42f5-9f8c-9fb40470f468 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:08:40 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] VM Stopped (Lifecycle Event)
Apr 14 19:08:40 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1532c862-2d10-4c28-84bf-36048868419e None None] [instance: d4a54fb1-bd66-42f5-9f8c-9fb40470f468] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:08:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:08:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:08:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:08:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "0fd6574c-2f67-46a9-838d-81f125c01b13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:08:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:57 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:08:57 user nova-compute[71308]: INFO nova.compute.claims [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Claim successful on node user
Apr 14 19:08:57 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:08:57 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:08:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.network.neutron [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:08:58 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:08:58 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Creating image(s)
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "/opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "/opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.policy [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dda4004af79e4162acea243b475c4fad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ba27cb61ba410a875c07ad41d363ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.152s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk 1073741824" returned: 0 in 0.062s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Cannot resize image /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.objects.instance [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lazy-loading 'migration_context' on Instance uuid 0fd6574c-2f67-46a9-838d-81f125c01b13 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Ensure instance console log exists: /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:08:58 user nova-compute[71308]: DEBUG nova.network.neutron [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Successfully created port: 7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:08:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Successfully updated port: 7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:08:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "refresh_cache-0fd6574c-2f67-46a9-838d-81f125c01b13" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:08:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquired lock "refresh_cache-0fd6574c-2f67-46a9-838d-81f125c01b13" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:08:59 user nova-compute[71308]: DEBUG nova.network.neutron [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:08:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received event network-changed-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:08:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Refreshing instance network info cache due to event network-changed-7ac85dee-ddfb-4242-81dd-0e7b659329a8. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:08:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] Acquiring lock "refresh_cache-0fd6574c-2f67-46a9-838d-81f125c01b13" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.network.neutron [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.network.neutron [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Updating instance_info_cache with network_info: [{"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Releasing lock "refresh_cache-0fd6574c-2f67-46a9-838d-81f125c01b13" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Instance network_info: |[{"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] Acquired lock "refresh_cache-0fd6574c-2f67-46a9-838d-81f125c01b13" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.network.neutron [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Refreshing network info cache for port 7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Start _get_guest_xml network_info=[{"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:09:00 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:09:00 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-925939041',display_name='tempest-VolumesNegativeTest-instance-925939041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-925939041',id=43,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ba27cb61ba410a875c07ad41d363ba',ramdisk_id='',reservation_id='r-1jjexate',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1776527759',owner_user_name='tempest-VolumesNegativeTest-1776527759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:08:58Z,user_data=None,user_id='dda4004af79e4162acea243b475c4fad',uuid=0fd6574c-2f67-46a9-838d-81f125c01b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Converting VIF {"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:5c:72,bridge_name='br-int',has_traffic_filtering=True,id=7ac85dee-ddfb-4242-81dd-0e7b659329a8,network=Network(02b050da-5d63-4f05-b047-6d1e39c1493c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac85dee-dd') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.objects.instance [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fd6574c-2f67-46a9-838d-81f125c01b13 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:09:00 user nova-compute[71308]:   <uuid>0fd6574c-2f67-46a9-838d-81f125c01b13</uuid>
Apr 14 19:09:00 user nova-compute[71308]:   <name>instance-0000002b</name>
Apr 14 19:09:00 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:09:00 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:09:00 user nova-compute[71308]:   <metadata>
Apr 14 19:09:00 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:09:00 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:09:00 user nova-compute[71308]:       <nova:name>tempest-VolumesNegativeTest-instance-925939041</nova:name>
Apr 14 19:09:00 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:09:00</nova:creationTime>
Apr 14 19:09:00 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:09:00 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:09:00 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:09:00 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:09:00 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:09:00 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:09:00 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:09:00 user nova-compute[71308]:       <nova:owner>
Apr 14 19:09:00 user nova-compute[71308]:         <nova:user uuid="dda4004af79e4162acea243b475c4fad">tempest-VolumesNegativeTest-1776527759-project-member</nova:user>
Apr 14 19:09:00 user nova-compute[71308]:         <nova:project uuid="f7ba27cb61ba410a875c07ad41d363ba">tempest-VolumesNegativeTest-1776527759</nova:project>
Apr 14 19:09:00 user nova-compute[71308]:       </nova:owner>
Apr 14 19:09:00 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 19:09:00 user nova-compute[71308]:       <nova:ports>
Apr 14 19:09:00 user nova-compute[71308]:         <nova:port uuid="7ac85dee-ddfb-4242-81dd-0e7b659329a8">
Apr 14 19:09:00 user nova-compute[71308]:           <nova:ip type="fixed" address="192.168.233.225" ipVersion="4"/>
Apr 14 19:09:00 user nova-compute[71308]:         </nova:port>
Apr 14 19:09:00 user nova-compute[71308]:       </nova:ports>
Apr 14 19:09:00 user nova-compute[71308]:     </nova:instance>
Apr 14 19:09:00 user nova-compute[71308]:   </metadata>
Apr 14 19:09:00 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:09:00 user nova-compute[71308]:     <system>
Apr 14 19:09:00 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:09:00 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:09:00 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:09:00 user nova-compute[71308]:       <entry name="serial">0fd6574c-2f67-46a9-838d-81f125c01b13</entry>
Apr 14 19:09:00 user nova-compute[71308]:       <entry name="uuid">0fd6574c-2f67-46a9-838d-81f125c01b13</entry>
Apr 14 19:09:00 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:09:00 user nova-compute[71308]:     </system>
Apr 14 19:09:00 user nova-compute[71308]:   </sysinfo>
Apr 14 19:09:00 user nova-compute[71308]:   <os>
Apr 14 19:09:00 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:09:00 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:09:00 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:09:00 user nova-compute[71308]:   </os>
Apr 14 19:09:00 user nova-compute[71308]:   <features>
Apr 14 19:09:00 user nova-compute[71308]:     <acpi/>
Apr 14 19:09:00 user nova-compute[71308]:     <apic/>
Apr 14 19:09:00 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:09:00 user nova-compute[71308]:   </features>
Apr 14 19:09:00 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:09:00 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:09:00 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:09:00 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:09:00 user nova-compute[71308]:   </clock>
Apr 14 19:09:00 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:09:00 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:09:00 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:09:00 user nova-compute[71308]:   </cpu>
Apr 14 19:09:00 user nova-compute[71308]:   <devices>
Apr 14 19:09:00 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:09:00 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:09:00 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk"/>
Apr 14 19:09:00 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:09:00 user nova-compute[71308]:     </disk>
Apr 14 19:09:00 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:09:00 user nova-compute[71308]:       <mac address="fa:16:3e:16:5c:72"/>
Apr 14 19:09:00 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:09:00 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:09:00 user nova-compute[71308]:       <target dev="tap7ac85dee-dd"/>
Apr 14 19:09:00 user nova-compute[71308]:     </interface>
Apr 14 19:09:00 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:09:00 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/console.log" append="off"/>
Apr 14 19:09:00 user nova-compute[71308]:     </serial>
Apr 14 19:09:00 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:09:00 user nova-compute[71308]:     <video>
Apr 14 19:09:00 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:09:00 user nova-compute[71308]:     </video>
Apr 14 19:09:00 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:09:00 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:09:00 user nova-compute[71308]:     </rng>
Apr 14 19:09:00 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:09:00 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:09:00 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:09:00 user nova-compute[71308]:     </memballoon>
Apr 14 19:09:00 user nova-compute[71308]:   </devices>
Apr 14 19:09:00 user nova-compute[71308]: </domain>
Apr 14 19:09:00 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-925939041',display_name='tempest-VolumesNegativeTest-instance-925939041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-925939041',id=43,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7ba27cb61ba410a875c07ad41d363ba',ramdisk_id='',reservation_id='r-1jjexate',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1776527759',owner_user_name='tempest-VolumesNegativeTest-1776527759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:08:58Z,user_data=None,user_id='dda4004af79e4162acea243b475c4fad',uuid=0fd6574c-2f67-46a9-838d-81f125c01b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Converting VIF {"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:5c:72,bridge_name='br-int',has_traffic_filtering=True,id=7ac85dee-ddfb-4242-81dd-0e7b659329a8,network=Network(02b050da-5d63-4f05-b047-6d1e39c1493c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac85dee-dd') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG os_vif [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:5c:72,bridge_name='br-int',has_traffic_filtering=True,id=7ac85dee-ddfb-4242-81dd-0e7b659329a8,network=Network(02b050da-5d63-4f05-b047-6d1e39c1493c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac85dee-dd') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ac85dee-dd, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ac85dee-dd, col_values=(('external_ids', {'iface-id': '7ac85dee-ddfb-4242-81dd-0e7b659329a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:5c:72', 'vm-uuid': '0fd6574c-2f67-46a9-838d-81f125c01b13'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:00 user nova-compute[71308]: INFO os_vif [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:5c:72,bridge_name='br-int',has_traffic_filtering=True,id=7ac85dee-ddfb-4242-81dd-0e7b659329a8,network=Network(02b050da-5d63-4f05-b047-6d1e39c1493c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac85dee-dd')
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] No VIF found with MAC fa:16:3e:16:5c:72, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.network.neutron [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Updated VIF entry in instance network info cache for port 7ac85dee-ddfb-4242-81dd-0e7b659329a8. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG nova.network.neutron [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Updating instance_info_cache with network_info: [{"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-52fe5a48-ccca-4106-8b88-7cb6226c8f22 req-d03c84de-ff63-43c8-9714-42f54a6767a7 service nova] Releasing lock "refresh_cache-0fd6574c-2f67-46a9-838d-81f125c01b13" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:09:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received event network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] Acquiring lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] No waiting events found dispatching network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:02 user nova-compute[71308]: WARNING nova.compute.manager [req-c8b2a343-9024-4a12-a0bb-35d44a9ac80b req-3fc603a8-e927-4c72-a7b9-6bdd42b3dbbb service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received unexpected event network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance with vm_state building and task_state spawning.
Apr 14 19:09:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received event network-changed-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG nova.compute.manager [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Refreshing instance network info cache due to event network-changed-ef166576-430e-47da-b169-915c4a0cd97c. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] Acquiring lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] Acquired lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:09:02 user nova-compute[71308]: DEBUG nova.network.neutron [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Refreshing network info cache for port ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.network.neutron [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updated VIF entry in instance network info cache for port ef166576-430e-47da-b169-915c4a0cd97c. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.network.neutron [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updating instance_info_cache with network_info: [{"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-340ebcd8-e13f-4b1a-9092-f9f9d7a42872 req-de81e150-b29f-4d03-a585-e596b4ade102 service nova] Releasing lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499343.9233449, 0fd6574c-2f67-46a9-838d-81f125c01b13 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:09:03 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] VM Resumed (Lifecycle Event)
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:09:03 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Instance spawned successfully.
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:03 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499343.92503, 0fd6574c-2f67-46a9-838d-81f125c01b13 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:09:03 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] VM Started (Lifecycle Event)
Apr 14 19:09:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:09:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:09:04 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:09:04 user nova-compute[71308]: INFO nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 14 19:09:04 user nova-compute[71308]: DEBUG nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:09:04 user nova-compute[71308]: INFO nova.compute.manager [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Took 6.52 seconds to build instance.
Apr 14 19:09:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received event network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] Acquiring lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:04 user nova-compute[71308]: DEBUG nova.compute.manager [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] No waiting events found dispatching network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:04 user nova-compute[71308]: WARNING nova.compute.manager [req-936c2627-39e1-42dd-8d09-d1fde1443f99 req-975a6154-dda9-4386-adac-d9a144b1adee service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received unexpected event network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance with vm_state active and task_state None.
Apr 14 19:09:04 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-631a1f92-02fe-48bd-b0ac-675f2d65473b tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.652s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:05 user nova-compute[71308]: INFO nova.compute.manager [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attaching volume 4f63993f-07b3-48ef-9b2d-c50f98c837fa to /dev/vdb
Apr 14 19:09:05 user nova-compute[71308]: DEBUG os_brick.utils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1f6c90-3733-4847-a656-0c472501c338]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcbce3d-1873-4195-9e11-e2caca51b7ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25dc083-d1e8-4731-8a59-06a0a0d0685d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b3986-127a-41c2-8fc6-7add61848a0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:09:05 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:09:05 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f458be6-835e-443c-93ff-d80bf7c07a28]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG os_brick.utils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:09:05 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating existing volume attachment record: b0e6a95e-db77-4dd1-a96c-d5d1a241c31d {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:06 user nova-compute[71308]: INFO nova.compute.manager [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Detaching volume 732c36bf-d3d1-437c-91f5-710fea1de62b
Apr 14 19:09:06 user nova-compute[71308]: INFO nova.virt.block_device [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Attempting to driver detach volume 732c36bf-d3d1-437c-91f5-710fea1de62b from mountpoint /dev/vdc
Apr 14 19:09:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Attempting to detach device vdc from instance 179270ef-7866-4ee7-af13-ec3ea5e7525a from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:09:06 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:09:06 user nova-compute[71308]:   <source dev="/dev/sdd"/>
Apr 14 19:09:06 user nova-compute[71308]:   <target dev="vdc" bus="virtio"/>
Apr 14 19:09:06 user nova-compute[71308]:   <serial>732c36bf-d3d1-437c-91f5-710fea1de62b</serial>
Apr 14 19:09:06 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 19:09:06 user nova-compute[71308]: </disk>
Apr 14 19:09:06 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:09:06 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully detached device vdc from instance 179270ef-7866-4ee7-af13-ec3ea5e7525a from the persistent domain config.
Apr 14 19:09:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 179270ef-7866-4ee7-af13-ec3ea5e7525a from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:09:06 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:09:06 user nova-compute[71308]:   <source dev="/dev/sdd"/>
Apr 14 19:09:06 user nova-compute[71308]:   <target dev="vdc" bus="virtio"/>
Apr 14 19:09:06 user nova-compute[71308]:   <serial>732c36bf-d3d1-437c-91f5-710fea1de62b</serial>
Apr 14 19:09:06 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 19:09:06 user nova-compute[71308]: </disk>
Apr 14 19:09:06 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681499346.5906794, 179270ef-7866-4ee7-af13-ec3ea5e7525a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 19:09:06 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully detached device vdc from instance 179270ef-7866-4ee7-af13-ec3ea5e7525a from the live domain config.
Apr 14 19:09:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faYycBIN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:09:06 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6f7f72-dc50-4570-a633-09ddbbb1d3c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:09:06 user nova-compute[71308]: No targets found.
Apr 14 19:09:06 user nova-compute[71308]: iSNS:
Apr 14 19:09:06 user nova-compute[71308]: No targets found.
Apr 14 19:09:06 user nova-compute[71308]: STATIC:
Apr 14 19:09:06 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:09:06 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:09:06 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:09:06 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b
Apr 14 19:09:06 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:09:06 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:09:06 user nova-compute[71308]: FIRMWARE:
Apr 14 19:09:06 user nova-compute[71308]: No targets found.
Apr 14 19:09:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:09:06 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:09:06 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab5939-6770-4806-b4a1-e3e6fbe2ffcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a4a819-cdeb-4cb3-ad9b-d909499c7824]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:06 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:09:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:06 user nova-compute[71308]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b (non-flash)
Apr 14 19:09:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22306f7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b'): ({'sdd'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Removing single pathed devices sdd {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c5442e-ab18-4ae4-a24c-2a6f60815b62]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5abdc55-ed5c-4e5e-ab4b-7e62931aecd8]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flushing IO for device /dev/sdd {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d0025d-52a8-465b-8760-d7df73ca88c5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d05837-520a-43b0-9386-27c95f9917f8]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] SCSI volumes sdd have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[143842f4-d946-449b-bab4-ba98a9a990cd]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cded541b-40b4-4107-9c29-9d551430a902]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b, portal: 172.16.0.220,3260]
Apr 14 19:09:06 user nova-compute[71308]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b, portal: 172.16.0.220,3260] successful.
Apr 14 19:09:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732c36bf-d3d1-437c-91f5-710fea1de62b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c34d7-566b-4470-a972-b135ba86b74c]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] <== disconnect_volume: return (304ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:09:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:09:07 user nova-compute[71308]: DEBUG nova.objects.instance [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'flavor' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:09:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-b7cc3098-db58-41a9-b5d6-cb842e6c3f4d tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.913s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSmEnXbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:09:10 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:09:10 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:09:10 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4303c7-2914-4af7-ae63-e1e02805c2e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:09:10 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eea2b8-f106-4a2f-88f2-d10df3ae75f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa] added
Apr 14 19:09:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[75accc7e-c021-4c1b-b941-6da2d3326458]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[011efa6c-f847-4330-b9c0-fe4349e331a6]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSmEnXbN {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSmEnXbN" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc494a9c-66a9-42d3-b9d2-63f8399793eb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSmEnXbN'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d872a0a-bac3-4d97-8cdb-dadaca5205bb]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305c874-2615-40eb-aa90-2e3a74ead639]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb6d6eb-8504-49bb-8ad5-fbc5061b36f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa, portal: 172.16.0.220,3260]
Apr 14 19:09:10 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa, portal: 172.16.0.220,3260] successful.
Apr 14 19:09:10 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:10 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae92c674-fc6a-4ee8-b7f2-2bd926ec925e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea341f9-4df1-4d55-b9de-a829118085c2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:11 user nova-compute[71308]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa (non-flash)
Apr 14 19:09:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:11 user nova-compute[71308]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa (non-flash)
Apr 14 19:09:11 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a157f70-54e3-4952-a408-00bc2da1dd2e]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSmEnXbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:09:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:09:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:09:12 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26334313731626235', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:09:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334313731626235', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:09:12 user nova-compute[71308]: DEBUG nova.objects.instance [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:09:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 19:09:12 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:09:12 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 19:09:12 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:09:12 user nova-compute[71308]:   <serial>4f63993f-07b3-48ef-9b2d-c50f98c837fa</serial>
Apr 14 19:09:12 user nova-compute[71308]: </disk>
Apr 14 19:09:12 user nova-compute[71308]:  {{(pid=71308) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 19:09:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:09:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:09:12 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] No VIF found with MAC fa:16:3e:9f:62:f6, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:09:12 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-fc4ba929-3e66-4767-bf31-50c978baff36 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.836s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:13 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:13 user nova-compute[71308]: INFO nova.compute.manager [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Detaching volume 4f63993f-07b3-48ef-9b2d-c50f98c837fa
Apr 14 19:09:13 user nova-compute[71308]: INFO nova.virt.block_device [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Attempting to driver detach volume 4f63993f-07b3-48ef-9b2d-c50f98c837fa from mountpoint /dev/vdb
Apr 14 19:09:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:09:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Attempting to detach device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the persistent domain config. {{(pid=71308) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 19:09:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:09:13 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:09:13 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 19:09:13 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:09:13 user nova-compute[71308]:   <serial>4f63993f-07b3-48ef-9b2d-c50f98c837fa</serial>
Apr 14 19:09:13 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:09:13 user nova-compute[71308]: </disk>
Apr 14 19:09:13 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:09:13 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully detached device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the persistent domain config.
Apr 14 19:09:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9379580-fd2f-4468-9ed3-7109735195be from the live domain config. {{(pid=71308) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 19:09:13 user nova-compute[71308]: DEBUG nova.virt.libvirt.guest [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 19:09:13 user nova-compute[71308]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:09:13 user nova-compute[71308]:   <source dev="/dev/sdb"/>
Apr 14 19:09:13 user nova-compute[71308]:   <target dev="vdb" bus="virtio"/>
Apr 14 19:09:13 user nova-compute[71308]:   <serial>4f63993f-07b3-48ef-9b2d-c50f98c837fa</serial>
Apr 14 19:09:13 user nova-compute[71308]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 19:09:13 user nova-compute[71308]: </disk>
Apr 14 19:09:13 user nova-compute[71308]:  {{(pid=71308) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 19:09:13 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "be4d9a7a-db6a-4590-9d91-7283024477f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Received event <DeviceRemovedEvent: 1681499354.447685, a9379580-fd2f-4468-9ed3-7109735195be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71308) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 19:09:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully detached device vdb from instance a9379580-fd2f-4468-9ed3-7109735195be from the live domain config.
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSmEnXbN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:09:14 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:09:14 user nova-compute[71308]: INFO nova.compute.claims [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Claim successful on node user
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[84127afc-fb15-4811-a804-1d69a35db647]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:09:14 user nova-compute[71308]: No targets found.
Apr 14 19:09:14 user nova-compute[71308]: iSNS:
Apr 14 19:09:14 user nova-compute[71308]: No targets found.
Apr 14 19:09:14 user nova-compute[71308]: STATIC:
Apr 14 19:09:14 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:09:14 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:09:14 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:09:14 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa
Apr 14 19:09:14 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:09:14 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:09:14 user nova-compute[71308]: FIRMWARE:
Apr 14 19:09:14 user nova-compute[71308]: No targets found.
Apr 14 19:09:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:09:14 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:09:14 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7664ad-cf53-4516-88d5-d4fdc556a5fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61dd39c-1323-45a1-8829-c92027e13533]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:14 user nova-compute[71308]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa (non-flash)
Apr 14 19:09:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:14 user nova-compute[71308]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa (non-flash)
Apr 14 19:09:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f22307b3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7048020-c72e-41bf-a415-41654c0ed0e7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[986fbf1d-9c78-4c13-83a2-8ef858a7be65]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c4a563-6072-4fe8-945e-2cc1a2062ae2]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab1a16e-9954-4220-8ed7-5b2cc6911087]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d4f3d6-a2b3-4179-b60f-d96c07214238]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e796ec-35a4-496e-819f-f9ef56777adb]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa, portal: 172.16.0.220,3260]
Apr 14 19:09:14 user nova-compute[71308]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa, portal: 172.16.0.220,3260] successful.
Apr 14 19:09:14 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f63993f-07b3-48ef-9b2d-c50f98c837fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73ecffc-281a-4f08-b07e-d8c17f66dec5]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] <== disconnect_volume: return (316ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.network.neutron [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:09:14 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:09:14 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:09:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:09:15 user nova-compute[71308]: INFO nova.virt.block_device [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Booting with volume 430ecbd6-7688-4f04-b31b-6894390ceae7 at /dev/vda
Apr 14 19:09:15 user nova-compute[71308]: DEBUG nova.policy [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc3bed70703a49c8bdec2f50193c7f70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d2bf68325a4a18934a8403571c24bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG os_brick.utils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cc2687-d11d-493b-872f-318519674ad9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e082dd8e65\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[600784eb-13f3-4508-b17b-d03ee1aadc38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8272f3f0-fcc9-49eb-9a60-3312c40f02e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ea9d23-4d58-4cd2-82ed-bc63893fb43d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Running cmd (subprocess): nvme version {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] 'nvme version' failed. Not Retrying. {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] nvme not present on system {{(pid=71308) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 19:09:15 user nova-compute[71308]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[11495067-bd42-4573-a38e-b15792d124e3]: (4, '') {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71308) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.lightos [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] LIGHTOS: no hostnqn found. {{(pid=71308) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG os_brick.utils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e082dd8e65', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG nova.virt.block_device [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Updating existing volume attachment record: d519b75e-2a13-44bd-a5ef-37ce9fcc8eaf {{(pid=71308) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'flavor' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7f0bdc22-8346-456b-84c1-d0ba3569414d tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.053s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG nova.network.neutron [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Successfully created port: 1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "46d51513-1995-43c5-976a-40789ae575f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "46d51513-1995-43c5-976a-40789ae575f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "46d51513-1995-43c5-976a-40789ae575f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:16 user nova-compute[71308]: INFO nova.compute.manager [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Terminating instance
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received event network-vif-unplugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] Acquiring lock "46d51513-1995-43c5-976a-40789ae575f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] No waiting events found dispatching network-vif-unplugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-0a6f1070-f574-4607-8285-fa2ce2d34dcc req-75aae369-570b-4a0f-8d4a-1b246b2f26fc service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received event network-vif-unplugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:16 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Instance destroyed successfully.
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lazy-loading 'resources' on Instance uuid 46d51513-1995-43c5-976a-40789ae575f1 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T18:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2011359159',display_name='tempest-ServerActionsTestJSON-server-2011359159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2011359159',id=34,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1SNCDT2jFA3MV2LOQf5/jQifTaElAyZBRvMGKPELy+qfHp7jNzbss7chCZ4Lyi4Hf1AsrbTQ0uCfJEZdUMCdLIpd/tPG6dSXTzuszoOSIUZSVUhcQCRAZ+G6fBKwSeEg==',key_name='tempest-keypair-1907005832',keypairs=<?>,launch_index=0,launched_at=2023-04-14T18:59:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f028a79640b848228dc6e654a0eef49b',ramdisk_id='',reservation_id='r-ap6g1hl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-2112054326',owner_user_name='tempest-ServerActionsTestJSON-2112054326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T18:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55fa4abe2fdd48cb91f39bf8156a7793',uuid=46d51513-1995-43c5-976a-40789ae575f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converting VIF {"id": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "address": "fa:16:3e:b3:87:0a", "network": {"id": "cfabb8bd-6f49-4a21-90ab-ee230e7003a9", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1194537843-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f028a79640b848228dc6e654a0eef49b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48f196d4-dd", "ovs_interfaceid": "48f196d4-dd0c-4499-8b7b-b0c4199cc059", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=48f196d4-dd0c-4499-8b7b-b0c4199cc059,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f196d4-dd') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG os_vif [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=48f196d4-dd0c-4499-8b7b-b0c4199cc059,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f196d4-dd') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48f196d4-dd, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:09:16 user nova-compute[71308]: INFO os_vif [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:87:0a,bridge_name='br-int',has_traffic_filtering=True,id=48f196d4-dd0c-4499-8b7b-b0c4199cc059,network=Network(cfabb8bd-6f49-4a21-90ab-ee230e7003a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48f196d4-dd')
Apr 14 19:09:16 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Deleting instance files /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1_del
Apr 14 19:09:16 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Deletion of /opt/stack/data/nova/instances/46d51513-1995-43c5-976a-40789ae575f1_del complete
Apr 14 19:09:16 user nova-compute[71308]: INFO nova.compute.manager [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 19:09:16 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:09:16 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 46d51513-1995-43c5-976a-40789ae575f1] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Successfully updated port: 1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquired lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:17 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Took 0.83 seconds to deallocate network for instance.
Apr 14 19:09:17 user nova-compute[71308]: DEBUG nova.network.neutron [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Updating instance_info_cache with network_info: [{"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received event network-vif-deleted-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:17 user nova-compute[71308]: INFO nova.compute.manager [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Neutron deleted interface 48f196d4-dd0c-4499-8b7b-b0c4199cc059; detaching it from the instance and deleting it from the info cache
Apr 14 19:09:17 user nova-compute[71308]: DEBUG nova.network.neutron [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Releasing lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Instance network_info: |[{"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-24cba4c1-7a50-4ac6-9b8c-e28363ac231f req-55680696-85d9-44fb-80dd-d17f22a482f0 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Detach interface failed, port_id=48f196d4-dd0c-4499-8b7b-b0c4199cc059, reason: Instance 46d51513-1995-43c5-976a-40789ae575f1 could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:18 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Deleted allocations for instance 46d51513-1995-43c5-976a-40789ae575f1
Apr 14 19:09:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d98b26ad-386c-4efc-a918-0d4c0908472c tempest-ServerActionsTestJSON-2112054326 tempest-ServerActionsTestJSON-2112054326-project-member] Lock "46d51513-1995-43c5-976a-40789ae575f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.225s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received event network-vif-plugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Acquiring lock "46d51513-1995-43c5-976a-40789ae575f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Lock "46d51513-1995-43c5-976a-40789ae575f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] No waiting events found dispatching network-vif-plugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:18 user nova-compute[71308]: WARNING nova.compute.manager [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Received unexpected event network-vif-plugged-48f196d4-dd0c-4499-8b7b-b0c4199cc059 for instance with vm_state deleted and task_state None.
Apr 14 19:09:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received event network-changed-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG nova.compute.manager [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Refreshing instance network info cache due to event network-changed-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Acquiring lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Acquired lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG nova.network.neutron [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Refreshing network info cache for port 1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:09:18 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG nova.network.neutron [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Updated VIF entry in instance network info cache for port 1ec8a1a9-4379-425f-90c0-7781c1bf8e7d. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG nova.network.neutron [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Updating instance_info_cache with network_info: [{"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f742181f-59ed-44df-a45c-ce573f952a9c req-8795bf3a-f544-4264-b38f-16fd84276591 service nova] Releasing lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:09:20 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Creating image(s)
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Did not create local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Ensure instance console log exists: /opt/stack/data/nova/instances/be4d9a7a-db6a-4590-9d91-7283024477f8/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Start _get_guest_xml network_info=[{"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'attachment_id': 'd519b75e-2a13-44bd-a5ef-37ce9fcc8eaf', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsGLgDNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be4d9a7a-db6a-4590-9d91-7283024477f8', 'attached_at': '', 'detached_at': '', 'volume_id': '430ecbd6-7688-4f04-b31b-6894390ceae7', 'serial': '430ecbd6-7688-4f04-b31b-6894390ceae7'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:09:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:09:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Calling os-brick to attach iSCSI Volume {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsGLgDNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:09:20 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:09:20 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:09:20 user nova-compute[71308]: INFO os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[74514987-0190-49cd-abaf-8dbea5218282]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 19:09:20 user nova-compute[71308]:  {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a928ff6-4871-4425-a28f-7206970a32e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7] added\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7] added
Apr 14 19:09:20 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b04399f-a25b-46fb-89ef-92d7596bef66]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fff20b-13a1-41fd-9f18-c8ca49b0de70]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsGLgDNB {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsGLgDNB" returned: 0 in 0.022s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e26315-923b-43f8-bcf9-7afebc20225e]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsGLgDNB'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ef52b-cf41-46a0-b107-f0bb9150900d]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1a4927-3739-41f5-8cf6-e22adea4eff9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:20 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:20 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --login {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[df38437b-3e3a-4d98-874c-b54be219d763]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7, portal: 172.16.0.220,3260]
Apr 14 19:09:20 user nova-compute[71308]: Login to [iface: default, target: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7, portal: 172.16.0.220,3260] successful.
Apr 14 19:09:20 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:09:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:09:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8096MB free_disk=26.26360321044922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.139s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[143aa157-6a26-4360-87a6-ae7d0ad62d2a]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd7952-a65d-491b-bcd8-185f1f844e93]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:21 user nova-compute[71308]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 (non-flash)
Apr 14 19:09:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:09:21 user nova-compute[71308]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 (non-flash)
Apr 14 19:09:21 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.863s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to 172.16.0.220:3260 {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71308) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71308) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d203ba36-01f8-4c9a-9c0d-5bb5ec963efa]: (4, ('- - 0', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71308) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsGLgDNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71308) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a9379580-fd2f-4468-9ed3-7109735195be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 935022b4-4ba7-4b34-a758-a00081240b4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 179270ef-7866-4ee7-af13-ec3ea5e7525a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0fd6574c-2f67-46a9-838d-81f125c01b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance be4d9a7a-db6a-4590-9d91-7283024477f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.096s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== connect_volume: return (2098ms) {'type': 'block', 'scsi_wwn': '26164393130326332', 'path': '/dev/sdb'} {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164393130326332', 'path': '/dev/sdb'} {{(pid=71308) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1086325203',display_name='tempest-TestVolumeBootPattern-server-1086325203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1086325203',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg==',key_name='tempest-TestVolumeBootPattern-875294368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-esdx0i4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:09:15Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=be4d9a7a-db6a-4590-9d91-7283024477f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:e3:64,bridge_name='br-int',has_traffic_filtering=True,id=1ec8a1a9-4379-425f-90c0-7781c1bf8e7d,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec8a1a9-43') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.objects.instance [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'pci_devices' on Instance uuid be4d9a7a-db6a-4590-9d91-7283024477f8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:09:22 user nova-compute[71308]:   <uuid>be4d9a7a-db6a-4590-9d91-7283024477f8</uuid>
Apr 14 19:09:22 user nova-compute[71308]:   <name>instance-0000002c</name>
Apr 14 19:09:22 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:09:22 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:09:22 user nova-compute[71308]:   <metadata>
Apr 14 19:09:22 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:09:22 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:09:22 user nova-compute[71308]:       <nova:name>tempest-TestVolumeBootPattern-server-1086325203</nova:name>
Apr 14 19:09:22 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:09:20</nova:creationTime>
Apr 14 19:09:22 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:09:22 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:09:22 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:09:22 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:09:22 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:09:22 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:09:22 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:09:22 user nova-compute[71308]:       <nova:owner>
Apr 14 19:09:22 user nova-compute[71308]:         <nova:user uuid="fc3bed70703a49c8bdec2f50193c7f70">tempest-TestVolumeBootPattern-1560263906-project-member</nova:user>
Apr 14 19:09:22 user nova-compute[71308]:         <nova:project uuid="72d2bf68325a4a18934a8403571c24bb">tempest-TestVolumeBootPattern-1560263906</nova:project>
Apr 14 19:09:22 user nova-compute[71308]:       </nova:owner>
Apr 14 19:09:22 user nova-compute[71308]:       <nova:ports>
Apr 14 19:09:22 user nova-compute[71308]:         <nova:port uuid="1ec8a1a9-4379-425f-90c0-7781c1bf8e7d">
Apr 14 19:09:22 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 19:09:22 user nova-compute[71308]:         </nova:port>
Apr 14 19:09:22 user nova-compute[71308]:       </nova:ports>
Apr 14 19:09:22 user nova-compute[71308]:     </nova:instance>
Apr 14 19:09:22 user nova-compute[71308]:   </metadata>
Apr 14 19:09:22 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:09:22 user nova-compute[71308]:     <system>
Apr 14 19:09:22 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:09:22 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:09:22 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:09:22 user nova-compute[71308]:       <entry name="serial">be4d9a7a-db6a-4590-9d91-7283024477f8</entry>
Apr 14 19:09:22 user nova-compute[71308]:       <entry name="uuid">be4d9a7a-db6a-4590-9d91-7283024477f8</entry>
Apr 14 19:09:22 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:09:22 user nova-compute[71308]:     </system>
Apr 14 19:09:22 user nova-compute[71308]:   </sysinfo>
Apr 14 19:09:22 user nova-compute[71308]:   <os>
Apr 14 19:09:22 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:09:22 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:09:22 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:09:22 user nova-compute[71308]:   </os>
Apr 14 19:09:22 user nova-compute[71308]:   <features>
Apr 14 19:09:22 user nova-compute[71308]:     <acpi/>
Apr 14 19:09:22 user nova-compute[71308]:     <apic/>
Apr 14 19:09:22 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:09:22 user nova-compute[71308]:   </features>
Apr 14 19:09:22 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:09:22 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:09:22 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:09:22 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:09:22 user nova-compute[71308]:   </clock>
Apr 14 19:09:22 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:09:22 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:09:22 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:09:22 user nova-compute[71308]:   </cpu>
Apr 14 19:09:22 user nova-compute[71308]:   <devices>
Apr 14 19:09:22 user nova-compute[71308]:     <disk type="block" device="disk">
Apr 14 19:09:22 user nova-compute[71308]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 19:09:22 user nova-compute[71308]:       <source dev="/dev/sdb"/>
Apr 14 19:09:22 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:09:22 user nova-compute[71308]:       <serial>430ecbd6-7688-4f04-b31b-6894390ceae7</serial>
Apr 14 19:09:22 user nova-compute[71308]:     </disk>
Apr 14 19:09:22 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:09:22 user nova-compute[71308]:       <mac address="fa:16:3e:20:e3:64"/>
Apr 14 19:09:22 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:09:22 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:09:22 user nova-compute[71308]:       <target dev="tap1ec8a1a9-43"/>
Apr 14 19:09:22 user nova-compute[71308]:     </interface>
Apr 14 19:09:22 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:09:22 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/be4d9a7a-db6a-4590-9d91-7283024477f8/console.log" append="off"/>
Apr 14 19:09:22 user nova-compute[71308]:     </serial>
Apr 14 19:09:22 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:09:22 user nova-compute[71308]:     <video>
Apr 14 19:09:22 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:09:22 user nova-compute[71308]:     </video>
Apr 14 19:09:22 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:09:22 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:09:22 user nova-compute[71308]:     </rng>
Apr 14 19:09:22 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:09:22 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:09:22 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:09:22 user nova-compute[71308]:     </memballoon>
Apr 14 19:09:22 user nova-compute[71308]:   </devices>
Apr 14 19:09:22 user nova-compute[71308]: </domain>
Apr 14 19:09:22 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1086325203',display_name='tempest-TestVolumeBootPattern-server-1086325203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1086325203',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg==',key_name='tempest-TestVolumeBootPattern-875294368',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-esdx0i4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:09:15Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=be4d9a7a-db6a-4590-9d91-7283024477f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:e3:64,bridge_name='br-int',has_traffic_filtering=True,id=1ec8a1a9-4379-425f-90c0-7781c1bf8e7d,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec8a1a9-43') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG os_vif [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e3:64,bridge_name='br-int',has_traffic_filtering=True,id=1ec8a1a9-4379-425f-90c0-7781c1bf8e7d,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec8a1a9-43') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ec8a1a9-43, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ec8a1a9-43, col_values=(('external_ids', {'iface-id': '1ec8a1a9-4379-425f-90c0-7781c1bf8e7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:e3:64', 'vm-uuid': 'be4d9a7a-db6a-4590-9d91-7283024477f8'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:22 user nova-compute[71308]: INFO os_vif [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:e3:64,bridge_name='br-int',has_traffic_filtering=True,id=1ec8a1a9-4379-425f-90c0-7781c1bf8e7d,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec8a1a9-43')
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:09:22 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] No VIF found with MAC fa:16:3e:20:e3:64, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received event network-vif-plugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] Acquiring lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG nova.compute.manager [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] No waiting events found dispatching network-vif-plugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:23 user nova-compute[71308]: WARNING nova.compute.manager [req-844a984f-b898-44b1-a053-d0a5133cd727 req-c521276e-5fa0-421d-958a-262329fc3d2d service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received unexpected event network-vif-plugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance with vm_state building and task_state spawning.
Apr 14 19:09:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:23 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:09:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:09:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:09:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating instance_info_cache with network_info: [{"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-179270ef-7866-4ee7-af13-ec3ea5e7525a" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:09:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499365.8405013, be4d9a7a-db6a-4590-9d91-7283024477f8 => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:09:25 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] VM Resumed (Lifecycle Event)
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:09:25 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Instance spawned successfully.
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:09:25 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499365.8427966, be4d9a7a-db6a-4590-9d91-7283024477f8 => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:09:25 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] VM Started (Lifecycle Event)
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:09:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:09:25 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:09:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received event network-vif-plugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] Acquiring lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:26 user nova-compute[71308]: DEBUG nova.compute.manager [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] No waiting events found dispatching network-vif-plugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:26 user nova-compute[71308]: WARNING nova.compute.manager [req-97585cb1-8eff-4b0d-8261-8ba896be4e30 req-9fcc97bf-cfaf-48fc-8cee-371740359b61 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received unexpected event network-vif-plugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance with vm_state building and task_state spawning.
Apr 14 19:09:26 user nova-compute[71308]: INFO nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 14 19:09:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:09:26 user nova-compute[71308]: INFO nova.compute.manager [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Took 11.71 seconds to build instance.
Apr 14 19:09:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-a709399d-58d1-4aeb-8ee1-015a457d28be tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.813s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:31 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499356.7749763, 46d51513-1995-43c5-976a-40789ae575f1 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:09:31 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 46d51513-1995-43c5-976a-40789ae575f1] VM Stopped (Lifecycle Event)
Apr 14 19:09:31 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8b4093da-19ba-49d5-ae0d-362580ec73a5 None None] [instance: 46d51513-1995-43c5-976a-40789ae575f1] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:32 user nova-compute[71308]: INFO nova.compute.manager [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Terminating instance
Apr 14 19:09:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received event network-vif-unplugged-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] Acquiring lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] No waiting events found dispatching network-vif-unplugged-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG nova.compute.manager [req-3fe78c53-337f-429c-87ab-01d3cf65fa3b req-06463ff5-9732-42de-a619-9b59b6b0de35 service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received event network-vif-unplugged-7c974323-9ad0-4786-b46b-27b6d54a612b for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:09:32 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Instance destroyed successfully.
Apr 14 19:09:32 user nova-compute[71308]: DEBUG nova.objects.instance [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lazy-loading 'resources' on Instance uuid dab65dfd-f2a1-4631-82a2-70a18f0f33f7 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-483537759',display_name='tempest-VolumesActionsTest-instance-483537759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-483537759',id=42,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:07:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f71b0490e5a4d3b9300dc510b936a44',ramdisk_id='',reservation_id='r-uwxialvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1832164482',owner_user_name='tempest-VolumesActionsTest-1832164482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:07:48Z,user_data=None,user_id='0b1b6efb65b541ef992b66d9d06bd03f',uuid=dab65dfd-f2a1-4631-82a2-70a18f0f33f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converting VIF {"id": "7c974323-9ad0-4786-b46b-27b6d54a612b", "address": "fa:16:3e:28:3e:16", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c974323-9a", "ovs_interfaceid": "7c974323-9ad0-4786-b46b-27b6d54a612b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:3e:16,bridge_name='br-int',has_traffic_filtering=True,id=7c974323-9ad0-4786-b46b-27b6d54a612b,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c974323-9a') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG os_vif [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:3e:16,bridge_name='br-int',has_traffic_filtering=True,id=7c974323-9ad0-4786-b46b-27b6d54a612b,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c974323-9a') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c974323-9a, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:32 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:09:32 user nova-compute[71308]: INFO os_vif [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:3e:16,bridge_name='br-int',has_traffic_filtering=True,id=7c974323-9ad0-4786-b46b-27b6d54a612b,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c974323-9a')
Apr 14 19:09:32 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Deleting instance files /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7_del
Apr 14 19:09:32 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Deletion of /opt/stack/data/nova/instances/dab65dfd-f2a1-4631-82a2-70a18f0f33f7_del complete
Apr 14 19:09:33 user nova-compute[71308]: INFO nova.compute.manager [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 14 19:09:33 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:09:33 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:09:33 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:09:33 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:33 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Took 0.56 seconds to deallocate network for instance.
Apr 14 19:09:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:33 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:09:33 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:09:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:33 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Deleted allocations for instance dab65dfd-f2a1-4631-82a2-70a18f0f33f7
Apr 14 19:09:33 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-cf89e271-78b1-4682-80ef-1a48f9e5c249 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.608s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received event network-vif-plugged-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] Acquiring lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:34 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] Lock "dab65dfd-f2a1-4631-82a2-70a18f0f33f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] No waiting events found dispatching network-vif-plugged-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:34 user nova-compute[71308]: WARNING nova.compute.manager [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received unexpected event network-vif-plugged-7c974323-9ad0-4786-b46b-27b6d54a612b for instance with vm_state deleted and task_state None.
Apr 14 19:09:34 user nova-compute[71308]: DEBUG nova.compute.manager [req-047ca11f-715c-40b8-837d-74b86b4da3ce req-4f182c36-cfc0-46b5-9cd3-aaa4f1ef91ba service nova] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Received event network-vif-deleted-7c974323-9ad0-4786-b46b-27b6d54a612b {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:37 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:42 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:09:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:47 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499372.9646342, dab65dfd-f2a1-4631-82a2-70a18f0f33f7 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:09:47 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] VM Stopped (Lifecycle Event)
Apr 14 19:09:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-3a96e025-3e89-4c17-aa67-15567399385d None None] [instance: dab65dfd-f2a1-4631-82a2-70a18f0f33f7] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:09:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:56 user nova-compute[71308]: INFO nova.compute.manager [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Terminating instance
Apr 14 19:09:56 user nova-compute[71308]: DEBUG nova.compute.manager [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG nova.compute.manager [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-unplugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG nova.compute.manager [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-unplugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:56 user nova-compute[71308]: DEBUG nova.compute.manager [req-9dbce4fe-a845-4f08-af7a-2781e22c9f50 req-a1a6ff1b-cfa2-4863-9d03-ecca9008e94a service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-unplugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Instance destroyed successfully.
Apr 14 19:09:57 user nova-compute[71308]: DEBUG nova.objects.instance [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'resources' on Instance uuid 179270ef-7866-4ee7-af13-ec3ea5e7525a {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T19:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1127447025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1127447025',id=38,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMie4jk+eKDDeaE+UlFjfMzkkdZn5tHrG2pp7P8c6d+PQZvYazMq2yTH5MI/VepSyomDJZZ/cTr9HacR1kMWge6kZ4qBZES1sp1DTJQpGt0DwmP8idMT1Qs9zoNJj5wRSQ==',key_name='tempest-keypair-1365704596',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-e2gxcjgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=179270ef-7866-4ee7-af13-ec3ea5e7525a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "address": "fa:16:3e:f5:25:ae", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef01e15-90", "ovs_interfaceid": "fef01e15-9070-4b0b-ba18-0b9540774cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG os_vif [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfef01e15-90, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: INFO os_vif [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:25:ae,bridge_name='br-int',has_traffic_filtering=True,id=fef01e15-9070-4b0b-ba18-0b9540774cb9,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef01e15-90')
Apr 14 19:09:57 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Deleting instance files /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a_del
Apr 14 19:09:57 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Deletion of /opt/stack/data/nova/instances/179270ef-7866-4ee7-af13-ec3ea5e7525a_del complete
Apr 14 19:09:57 user nova-compute[71308]: INFO nova.compute.manager [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 19:09:57 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:58 user nova-compute[71308]: WARNING nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state active and task_state deleting.
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:58 user nova-compute[71308]: WARNING nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state active and task_state deleting.
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:58 user nova-compute[71308]: WARNING nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state active and task_state deleting.
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-unplugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-unplugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.compute.manager [req-59960ad8-2b12-477d-a1a6-e9457daf0cbf req-d8339406-a470-4378-ab4a-f3c10aa18040 service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-unplugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:09:58 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:09:58 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Took 1.74 seconds to deallocate network for instance.
Apr 14 19:09:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:09:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:09:59 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:09:59 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:09:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:09:59 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Deleted allocations for instance 179270ef-7866-4ee7-af13-ec3ea5e7525a
Apr 14 19:09:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-817728e4-95fb-4c3b-a87e-6281c0c14921 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.954s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] Acquiring lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:00 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] Lock "179270ef-7866-4ee7-af13-ec3ea5e7525a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] No waiting events found dispatching network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:00 user nova-compute[71308]: WARNING nova.compute.manager [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received unexpected event network-vif-plugged-fef01e15-9070-4b0b-ba18-0b9540774cb9 for instance with vm_state deleted and task_state None.
Apr 14 19:10:00 user nova-compute[71308]: DEBUG nova.compute.manager [req-6dc641fa-98df-423e-a151-943284e923c0 req-670c3ac6-4124-46ec-b704-35c74a55403e service nova] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Received event network-vif-deleted-fef01e15-9070-4b0b-ba18-0b9540774cb9 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:02 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:10:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:10:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:10:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:10:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:10:07 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:12 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499397.1531522, 179270ef-7866-4ee7-af13-ec3ea5e7525a => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:10:12 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] VM Stopped (Lifecycle Event)
Apr 14 19:10:12 user nova-compute[71308]: DEBUG nova.compute.manager [None req-957eb6a1-f6e5-4f25-8c90-667d468f9140 None None] [instance: 179270ef-7866-4ee7-af13-ec3ea5e7525a] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:12 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:15 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:17 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:19 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:10:20 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8183MB free_disk=26.283626556396484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance a9379580-fd2f-4468-9ed3-7109735195be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 935022b4-4ba7-4b34-a758-a00081240b4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 0fd6574c-2f67-46a9-838d-81f125c01b13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance be4d9a7a-db6a-4590-9d91-7283024477f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:10:20 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:22 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:10:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "e3fa57cc-781a-402e-91fc-e4ee5640960b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:10:24 user nova-compute[71308]: INFO nova.compute.claims [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Claim successful on node user
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.network.neutron [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:10:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:10:24 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Creating image(s)
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "/opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "/opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG nova.policy [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b1b6efb65b541ef992b66d9d06bd03f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f71b0490e5a4d3b9300dc510b936a44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:24 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.151s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk 1073741824" returned: 0 in 0.056s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Cannot resize image /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.objects.instance [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lazy-loading 'migration_context' on Instance uuid e3fa57cc-781a-402e-91fc-e4ee5640960b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Ensure instance console log exists: /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received event network-changed-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.compute.manager [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Refreshing instance network info cache due to event network-changed-f22a5e1e-5aed-419f-aa06-308984681fbc. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] Acquiring lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating instance_info_cache with network_info: [{"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] Acquired lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:10:25 user nova-compute[71308]: DEBUG nova.network.neutron [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Refreshing network info cache for port f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:10:26 user nova-compute[71308]: DEBUG nova.network.neutron [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Successfully created port: 2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:10:26 user nova-compute[71308]: DEBUG nova.network.neutron [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updated VIF entry in instance network info cache for port f22a5e1e-5aed-419f-aa06-308984681fbc. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:10:26 user nova-compute[71308]: DEBUG nova.network.neutron [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating instance_info_cache with network_info: [{"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:26 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4afa58a2-b4a1-4632-b74a-28095058f93e req-f0cd6f8a-8e24-432f-924a-5c12aae7fbb9 service nova] Releasing lock "refresh_cache-a9379580-fd2f-4468-9ed3-7109735195be" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:10:27 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:10:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Successfully updated port: 2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:10:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "refresh_cache-e3fa57cc-781a-402e-91fc-e4ee5640960b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:10:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquired lock "refresh_cache-e3fa57cc-781a-402e-91fc-e4ee5640960b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:10:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:10:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:10:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received event network-changed-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:27 user nova-compute[71308]: DEBUG nova.compute.manager [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Refreshing instance network info cache due to event network-changed-2446f800-78b9-4e6d-80cb-23be097676bd. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:10:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] Acquiring lock "refresh_cache-e3fa57cc-781a-402e-91fc-e4ee5640960b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.network.neutron [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Updating instance_info_cache with network_info: [{"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Releasing lock "refresh_cache-e3fa57cc-781a-402e-91fc-e4ee5640960b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Instance network_info: |[{"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] Acquired lock "refresh_cache-e3fa57cc-781a-402e-91fc-e4ee5640960b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Refreshing network info cache for port 2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Start _get_guest_xml network_info=[{"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:10:28 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:10:28 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2040926824',display_name='tempest-VolumesActionsTest-instance-2040926824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2040926824',id=45,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f71b0490e5a4d3b9300dc510b936a44',ramdisk_id='',reservation_id='r-w2emcmxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1832164482',owner_user_name='tempest-VolumesActionsTest-1832164482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:10:25Z,user_data=None,user_id='0b1b6efb65b541ef992b66d9d06bd03f',uuid=e3fa57cc-781a-402e-91fc-e4ee5640960b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converting VIF {"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=2446f800-78b9-4e6d-80cb-23be097676bd,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2446f800-78') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.objects.instance [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lazy-loading 'pci_devices' on Instance uuid e3fa57cc-781a-402e-91fc-e4ee5640960b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:10:28 user nova-compute[71308]:   <uuid>e3fa57cc-781a-402e-91fc-e4ee5640960b</uuid>
Apr 14 19:10:28 user nova-compute[71308]:   <name>instance-0000002d</name>
Apr 14 19:10:28 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:10:28 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:10:28 user nova-compute[71308]:   <metadata>
Apr 14 19:10:28 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:10:28 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:10:28 user nova-compute[71308]:       <nova:name>tempest-VolumesActionsTest-instance-2040926824</nova:name>
Apr 14 19:10:28 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:10:28</nova:creationTime>
Apr 14 19:10:28 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:10:28 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:10:28 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:10:28 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:10:28 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:10:28 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:10:28 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:10:28 user nova-compute[71308]:       <nova:owner>
Apr 14 19:10:28 user nova-compute[71308]:         <nova:user uuid="0b1b6efb65b541ef992b66d9d06bd03f">tempest-VolumesActionsTest-1832164482-project-member</nova:user>
Apr 14 19:10:28 user nova-compute[71308]:         <nova:project uuid="5f71b0490e5a4d3b9300dc510b936a44">tempest-VolumesActionsTest-1832164482</nova:project>
Apr 14 19:10:28 user nova-compute[71308]:       </nova:owner>
Apr 14 19:10:28 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 19:10:28 user nova-compute[71308]:       <nova:ports>
Apr 14 19:10:28 user nova-compute[71308]:         <nova:port uuid="2446f800-78b9-4e6d-80cb-23be097676bd">
Apr 14 19:10:28 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 19:10:28 user nova-compute[71308]:         </nova:port>
Apr 14 19:10:28 user nova-compute[71308]:       </nova:ports>
Apr 14 19:10:28 user nova-compute[71308]:     </nova:instance>
Apr 14 19:10:28 user nova-compute[71308]:   </metadata>
Apr 14 19:10:28 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:10:28 user nova-compute[71308]:     <system>
Apr 14 19:10:28 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:10:28 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:10:28 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:10:28 user nova-compute[71308]:       <entry name="serial">e3fa57cc-781a-402e-91fc-e4ee5640960b</entry>
Apr 14 19:10:28 user nova-compute[71308]:       <entry name="uuid">e3fa57cc-781a-402e-91fc-e4ee5640960b</entry>
Apr 14 19:10:28 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:10:28 user nova-compute[71308]:     </system>
Apr 14 19:10:28 user nova-compute[71308]:   </sysinfo>
Apr 14 19:10:28 user nova-compute[71308]:   <os>
Apr 14 19:10:28 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:10:28 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:10:28 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:10:28 user nova-compute[71308]:   </os>
Apr 14 19:10:28 user nova-compute[71308]:   <features>
Apr 14 19:10:28 user nova-compute[71308]:     <acpi/>
Apr 14 19:10:28 user nova-compute[71308]:     <apic/>
Apr 14 19:10:28 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:10:28 user nova-compute[71308]:   </features>
Apr 14 19:10:28 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:10:28 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:10:28 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:10:28 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:10:28 user nova-compute[71308]:   </clock>
Apr 14 19:10:28 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:10:28 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:10:28 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:10:28 user nova-compute[71308]:   </cpu>
Apr 14 19:10:28 user nova-compute[71308]:   <devices>
Apr 14 19:10:28 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:10:28 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:10:28 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk"/>
Apr 14 19:10:28 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:10:28 user nova-compute[71308]:     </disk>
Apr 14 19:10:28 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:10:28 user nova-compute[71308]:       <mac address="fa:16:3e:bc:07:e4"/>
Apr 14 19:10:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:10:28 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:10:28 user nova-compute[71308]:       <target dev="tap2446f800-78"/>
Apr 14 19:10:28 user nova-compute[71308]:     </interface>
Apr 14 19:10:28 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:10:28 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/console.log" append="off"/>
Apr 14 19:10:28 user nova-compute[71308]:     </serial>
Apr 14 19:10:28 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:10:28 user nova-compute[71308]:     <video>
Apr 14 19:10:28 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:10:28 user nova-compute[71308]:     </video>
Apr 14 19:10:28 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:10:28 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:10:28 user nova-compute[71308]:     </rng>
Apr 14 19:10:28 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:10:28 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:10:28 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:10:28 user nova-compute[71308]:     </memballoon>
Apr 14 19:10:28 user nova-compute[71308]:   </devices>
Apr 14 19:10:28 user nova-compute[71308]: </domain>
Apr 14 19:10:28 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2040926824',display_name='tempest-VolumesActionsTest-instance-2040926824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2040926824',id=45,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f71b0490e5a4d3b9300dc510b936a44',ramdisk_id='',reservation_id='r-w2emcmxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1832164482',owner_user_name='tempest-VolumesActionsTest-1832164482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:10:25Z,user_data=None,user_id='0b1b6efb65b541ef992b66d9d06bd03f',uuid=e3fa57cc-781a-402e-91fc-e4ee5640960b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converting VIF {"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=2446f800-78b9-4e6d-80cb-23be097676bd,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2446f800-78') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG os_vif [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=2446f800-78b9-4e6d-80cb-23be097676bd,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2446f800-78') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2446f800-78, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2446f800-78, col_values=(('external_ids', {'iface-id': '2446f800-78b9-4e6d-80cb-23be097676bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:07:e4', 'vm-uuid': 'e3fa57cc-781a-402e-91fc-e4ee5640960b'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:28 user nova-compute[71308]: INFO os_vif [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=2446f800-78b9-4e6d-80cb-23be097676bd,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2446f800-78')
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] No VIF found with MAC fa:16:3e:bc:07:e4, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Updated VIF entry in instance network info cache for port 2446f800-78b9-4e6d-80cb-23be097676bd. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG nova.network.neutron [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Updating instance_info_cache with network_info: [{"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:28 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-bc4cc761-0e3b-4cc0-b80b-857cbe7a6260 req-64b60117-1eb2-4f3d-bcbd-9f26238b90af service nova] Releasing lock "refresh_cache-e3fa57cc-781a-402e-91fc-e4ee5640960b" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:29 user nova-compute[71308]: INFO nova.compute.manager [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Terminating instance
Apr 14 19:10:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received event network-vif-unplugged-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] No waiting events found dispatching network-vif-unplugged-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-a8ff8f8b-c1a1-4507-8bcf-4b40c032ca4f req-134af061-9f36-4b5a-b41a-9bd4ed5fc8a4 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received event network-vif-unplugged-f22a5e1e-5aed-419f-aa06-308984681fbc for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:10:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Instance destroyed successfully.
Apr 14 19:10:30 user nova-compute[71308]: DEBUG nova.objects.instance [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lazy-loading 'resources' on Instance uuid a9379580-fd2f-4468-9ed3-7109735195be {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1761427350',display_name='tempest-SnapshotDataIntegrityTests-server-1761427350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1761427350',id=39,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrqSX4Dn4cbtD2ThR27vz4fxPv5iy/c0ZdVOmEv91SBknzw38dyQkj7dyYpk0+xiBPENn2s6fqiXGS4lq+2CMLc45iU3VwfBmaBTRKP0e+5nHYYYSr3CL2L7A6SUZfiQg==',key_name='tempest-SnapshotDataIntegrityTests-1211605812',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:03:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81575e6ed9bc41d2ad2ac1ad0fbd253d',ramdisk_id='',reservation_id='r-0mzbzz03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-593938196',owner_user_name='tempest-SnapshotDataIntegrityTests-593938196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:03:53Z,user_data=None,user_id='10cf3683f78d4724bb734e5280e8736b',uuid=a9379580-fd2f-4468-9ed3-7109735195be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Converting VIF {"id": "f22a5e1e-5aed-419f-aa06-308984681fbc", "address": "fa:16:3e:9f:62:f6", "network": {"id": "912a39a0-80e1-492a-a05a-8523964167a0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-663018666-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81575e6ed9bc41d2ad2ac1ad0fbd253d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf22a5e1e-5a", "ovs_interfaceid": "f22a5e1e-5aed-419f-aa06-308984681fbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:62:f6,bridge_name='br-int',has_traffic_filtering=True,id=f22a5e1e-5aed-419f-aa06-308984681fbc,network=Network(912a39a0-80e1-492a-a05a-8523964167a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22a5e1e-5a') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG os_vif [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:62:f6,bridge_name='br-int',has_traffic_filtering=True,id=f22a5e1e-5aed-419f-aa06-308984681fbc,network=Network(912a39a0-80e1-492a-a05a-8523964167a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22a5e1e-5a') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf22a5e1e-5a, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:10:30 user nova-compute[71308]: INFO os_vif [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:62:f6,bridge_name='br-int',has_traffic_filtering=True,id=f22a5e1e-5aed-419f-aa06-308984681fbc,network=Network(912a39a0-80e1-492a-a05a-8523964167a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf22a5e1e-5a')
Apr 14 19:10:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Deleting instance files /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be_del
Apr 14 19:10:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Deletion of /opt/stack/data/nova/instances/a9379580-fd2f-4468-9ed3-7109735195be_del complete
Apr 14 19:10:30 user nova-compute[71308]: INFO nova.compute.manager [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 14 19:10:30 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:10:30 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: a9379580-fd2f-4468-9ed3-7109735195be] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:31 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Took 0.72 seconds to deallocate network for instance.
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-943d7bb9-4784-4ae3-97a4-8284815a610d req-6467cb86-8c8a-4788-a34b-100022e20fc5 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received event network-vif-deleted-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:31 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Deleted allocations for instance a9379580-fd2f-4468-9ed3-7109735195be
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-086aad3a-fbd8-4cd8-9002-9baddd51a0e2 tempest-SnapshotDataIntegrityTests-593938196 tempest-SnapshotDataIntegrityTests-593938196-project-member] Lock "a9379580-fd2f-4468-9ed3-7109735195be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.386s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received event network-vif-plugged-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Acquiring lock "a9379580-fd2f-4468-9ed3-7109735195be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Lock "a9379580-fd2f-4468-9ed3-7109735195be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] No waiting events found dispatching network-vif-plugged-f22a5e1e-5aed-419f-aa06-308984681fbc {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:31 user nova-compute[71308]: WARNING nova.compute.manager [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Received unexpected event network-vif-plugged-f22a5e1e-5aed-419f-aa06-308984681fbc for instance with vm_state deleted and task_state None.
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received event network-vif-plugged-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Acquiring lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] No waiting events found dispatching network-vif-plugged-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:31 user nova-compute[71308]: WARNING nova.compute.manager [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received unexpected event network-vif-plugged-2446f800-78b9-4e6d-80cb-23be097676bd for instance with vm_state building and task_state spawning.
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received event network-vif-plugged-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Acquiring lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] No waiting events found dispatching network-vif-plugged-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:31 user nova-compute[71308]: WARNING nova.compute.manager [req-94c36a52-767e-4b24-b1e7-78f51332de0c req-59ebe9b5-7d82-4530-bbcf-9b82203a5db7 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received unexpected event network-vif-plugged-2446f800-78b9-4e6d-80cb-23be097676bd for instance with vm_state building and task_state spawning.
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499432.1188798, e3fa57cc-781a-402e-91fc-e4ee5640960b => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:10:32 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] VM Resumed (Lifecycle Event)
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:10:32 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Instance spawned successfully.
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:32 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499432.1212485, e3fa57cc-781a-402e-91fc-e4ee5640960b => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:10:32 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] VM Started (Lifecycle Event)
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:10:32 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:10:32 user nova-compute[71308]: INFO nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Took 7.44 seconds to spawn the instance on the hypervisor.
Apr 14 19:10:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:32 user nova-compute[71308]: INFO nova.compute.manager [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Took 8.12 seconds to build instance.
Apr 14 19:10:32 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-75cbcabb-eb91-4ccf-a54e-059d6b2f2383 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.217s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:45 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499430.3021505, a9379580-fd2f-4468-9ed3-7109735195be => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:10:45 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: a9379580-fd2f-4468-9ed3-7109735195be] VM Stopped (Lifecycle Event)
Apr 14 19:10:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-b438a2df-c3b3-4b19-9bf8-12e05f89b006 None None] [instance: a9379580-fd2f-4468-9ed3-7109735195be] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:10:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:10:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:10:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:10:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "0fd6574c-2f67-46a9-838d-81f125c01b13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:47 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:47 user nova-compute[71308]: INFO nova.compute.manager [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Terminating instance
Apr 14 19:10:47 user nova-compute[71308]: DEBUG nova.compute.manager [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:10:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received event network-vif-unplugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] Acquiring lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] No waiting events found dispatching network-vif-unplugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-6ef4a68b-5ac4-4a9b-9144-c2924ad0825e req-668b9371-dbf9-4ddf-864e-6f83fb2323be service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received event network-vif-unplugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:48 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Instance destroyed successfully.
Apr 14 19:10:48 user nova-compute[71308]: DEBUG nova.objects.instance [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lazy-loading 'resources' on Instance uuid 0fd6574c-2f67-46a9-838d-81f125c01b13 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-925939041',display_name='tempest-VolumesNegativeTest-instance-925939041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-925939041',id=43,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:09:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7ba27cb61ba410a875c07ad41d363ba',ramdisk_id='',reservation_id='r-1jjexate',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1776527759',owner_user_name='tempest-VolumesNegativeTest-1776527759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:09:04Z,user_data=None,user_id='dda4004af79e4162acea243b475c4fad',uuid=0fd6574c-2f67-46a9-838d-81f125c01b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Converting VIF {"id": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "address": "fa:16:3e:16:5c:72", "network": {"id": "02b050da-5d63-4f05-b047-6d1e39c1493c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "4eb9848184d546d5877b279a998af059", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac85dee-dd", "ovs_interfaceid": "7ac85dee-ddfb-4242-81dd-0e7b659329a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:5c:72,bridge_name='br-int',has_traffic_filtering=True,id=7ac85dee-ddfb-4242-81dd-0e7b659329a8,network=Network(02b050da-5d63-4f05-b047-6d1e39c1493c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac85dee-dd') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG os_vif [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:5c:72,bridge_name='br-int',has_traffic_filtering=True,id=7ac85dee-ddfb-4242-81dd-0e7b659329a8,network=Network(02b050da-5d63-4f05-b047-6d1e39c1493c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac85dee-dd') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ac85dee-dd, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:10:48 user nova-compute[71308]: INFO os_vif [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:5c:72,bridge_name='br-int',has_traffic_filtering=True,id=7ac85dee-ddfb-4242-81dd-0e7b659329a8,network=Network(02b050da-5d63-4f05-b047-6d1e39c1493c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac85dee-dd')
Apr 14 19:10:48 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Deleting instance files /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13_del
Apr 14 19:10:48 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Deletion of /opt/stack/data/nova/instances/0fd6574c-2f67-46a9-838d-81f125c01b13_del complete
Apr 14 19:10:48 user nova-compute[71308]: INFO nova.compute.manager [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 19:10:48 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:10:48 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:49 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Took 0.66 seconds to deallocate network for instance.
Apr 14 19:10:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-2a2607d8-ce75-4cf8-be1b-37c506ab6af6 req-bf988812-666b-4efe-89fc-6adbdad4a547 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received event network-vif-deleted-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:10:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:49 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Deleted allocations for instance 0fd6574c-2f67-46a9-838d-81f125c01b13
Apr 14 19:10:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-69da0086-39ff-4292-9b7d-740efb381e0d tempest-VolumesNegativeTest-1776527759 tempest-VolumesNegativeTest-1776527759-project-member] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received event network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Acquiring lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] No waiting events found dispatching network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:50 user nova-compute[71308]: WARNING nova.compute.manager [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received unexpected event network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance with vm_state deleted and task_state None.
Apr 14 19:10:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received event network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Acquiring lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] Lock "0fd6574c-2f67-46a9-838d-81f125c01b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] No waiting events found dispatching network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:50 user nova-compute[71308]: WARNING nova.compute.manager [req-7f1cdbfe-bee7-4013-b503-712ccb37f81a req-d089cf5a-00a2-42ef-9672-f24b3dd812b5 service nova] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Received unexpected event network-vif-plugged-7ac85dee-ddfb-4242-81dd-0e7b659329a8 for instance with vm_state deleted and task_state None.
Apr 14 19:10:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:10:51 user nova-compute[71308]: INFO nova.compute.claims [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Claim successful on node user
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:10:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.policy [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '716e5499c6eb483e9c88fd25606018d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb0956418bd462c84e1392a74b5ae2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:10:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Creating image(s)
Apr 14 19:10:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:51 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.148s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk 1073741824" returned: 0 in 0.052s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Cannot resize image /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'migration_context' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Ensure instance console log exists: /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:52 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Successfully created port: 9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Successfully updated port: 9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquired lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Starting instance... {{(pid=71308) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-changed-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Refreshing instance network info cache due to event network-changed-9ee81da0-d1c9-443e-b4ea-73648dd076fa. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] Acquiring lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:10:53 user nova-compute[71308]: INFO nova.compute.claims [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Claim successful on node user
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating instance_info_cache with network_info: [{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Start building networks asynchronously for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Releasing lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance network_info: |[{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] Acquired lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.neutron [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Refreshing network info cache for port 9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Start _get_guest_xml network_info=[{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:10:53 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:10:53 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1565912159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1565912159',id=46,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlIIFLFsgmEE/cdWpQjb+8JZ3zZZK7ioNqf8TeFKeaiDVMl2nNhJJg/zxBKMinLXJGljsSokaNaV14gZ/dazOcADVQr2+0DMzXCDvHQwDPG9oG9sf5EXCJoMu5yIEfKVw==',key_name='tempest-keypair-1714568544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-594lfxgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=00ddbcca-fe9f-4417-8b6f-96671e666aed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'pci_devices' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:10:53 user nova-compute[71308]:   <uuid>00ddbcca-fe9f-4417-8b6f-96671e666aed</uuid>
Apr 14 19:10:53 user nova-compute[71308]:   <name>instance-0000002e</name>
Apr 14 19:10:53 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:10:53 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:10:53 user nova-compute[71308]:   <metadata>
Apr 14 19:10:53 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:10:53 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:10:53 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1565912159</nova:name>
Apr 14 19:10:53 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:10:53</nova:creationTime>
Apr 14 19:10:53 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:10:53 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:10:53 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:10:53 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:10:53 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:10:53 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:10:53 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:10:53 user nova-compute[71308]:       <nova:owner>
Apr 14 19:10:53 user nova-compute[71308]:         <nova:user uuid="716e5499c6eb483e9c88fd25606018d9">tempest-AttachVolumeShelveTestJSON-1405261713-project-member</nova:user>
Apr 14 19:10:53 user nova-compute[71308]:         <nova:project uuid="ebb0956418bd462c84e1392a74b5ae2e">tempest-AttachVolumeShelveTestJSON-1405261713</nova:project>
Apr 14 19:10:53 user nova-compute[71308]:       </nova:owner>
Apr 14 19:10:53 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 19:10:53 user nova-compute[71308]:       <nova:ports>
Apr 14 19:10:53 user nova-compute[71308]:         <nova:port uuid="9ee81da0-d1c9-443e-b4ea-73648dd076fa">
Apr 14 19:10:53 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 19:10:53 user nova-compute[71308]:         </nova:port>
Apr 14 19:10:53 user nova-compute[71308]:       </nova:ports>
Apr 14 19:10:53 user nova-compute[71308]:     </nova:instance>
Apr 14 19:10:53 user nova-compute[71308]:   </metadata>
Apr 14 19:10:53 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:10:53 user nova-compute[71308]:     <system>
Apr 14 19:10:53 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:10:53 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:10:53 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:10:53 user nova-compute[71308]:       <entry name="serial">00ddbcca-fe9f-4417-8b6f-96671e666aed</entry>
Apr 14 19:10:53 user nova-compute[71308]:       <entry name="uuid">00ddbcca-fe9f-4417-8b6f-96671e666aed</entry>
Apr 14 19:10:53 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:10:53 user nova-compute[71308]:     </system>
Apr 14 19:10:53 user nova-compute[71308]:   </sysinfo>
Apr 14 19:10:53 user nova-compute[71308]:   <os>
Apr 14 19:10:53 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:10:53 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:10:53 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:10:53 user nova-compute[71308]:   </os>
Apr 14 19:10:53 user nova-compute[71308]:   <features>
Apr 14 19:10:53 user nova-compute[71308]:     <acpi/>
Apr 14 19:10:53 user nova-compute[71308]:     <apic/>
Apr 14 19:10:53 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:10:53 user nova-compute[71308]:   </features>
Apr 14 19:10:53 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:10:53 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:10:53 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:10:53 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:10:53 user nova-compute[71308]:   </clock>
Apr 14 19:10:53 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:10:53 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:10:53 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:10:53 user nova-compute[71308]:   </cpu>
Apr 14 19:10:53 user nova-compute[71308]:   <devices>
Apr 14 19:10:53 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:10:53 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:10:53 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk"/>
Apr 14 19:10:53 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:10:53 user nova-compute[71308]:     </disk>
Apr 14 19:10:53 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:10:53 user nova-compute[71308]:       <mac address="fa:16:3e:d0:ca:f7"/>
Apr 14 19:10:53 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:10:53 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:10:53 user nova-compute[71308]:       <target dev="tap9ee81da0-d1"/>
Apr 14 19:10:53 user nova-compute[71308]:     </interface>
Apr 14 19:10:53 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:10:53 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/console.log" append="off"/>
Apr 14 19:10:53 user nova-compute[71308]:     </serial>
Apr 14 19:10:53 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:10:53 user nova-compute[71308]:     <video>
Apr 14 19:10:53 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:10:53 user nova-compute[71308]:     </video>
Apr 14 19:10:53 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:10:53 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:10:53 user nova-compute[71308]:     </rng>
Apr 14 19:10:53 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:10:53 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:10:53 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:10:53 user nova-compute[71308]:     </memballoon>
Apr 14 19:10:53 user nova-compute[71308]:   </devices>
Apr 14 19:10:53 user nova-compute[71308]: </domain>
Apr 14 19:10:53 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1565912159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1565912159',id=46,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlIIFLFsgmEE/cdWpQjb+8JZ3zZZK7ioNqf8TeFKeaiDVMl2nNhJJg/zxBKMinLXJGljsSokaNaV14gZ/dazOcADVQr2+0DMzXCDvHQwDPG9oG9sf5EXCJoMu5yIEfKVw==',key_name='tempest-keypair-1714568544',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-594lfxgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=00ddbcca-fe9f-4417-8b6f-96671e666aed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG os_vif [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Allocating IP information in the background. {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] allocate_for_instance() {{(pid=71308) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:10:53 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ee81da0-d1, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9ee81da0-d1, col_values=(('external_ids', {'iface-id': '9ee81da0-d1c9-443e-b4ea-73648dd076fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:ca:f7', 'vm-uuid': '00ddbcca-fe9f-4417-8b6f-96671e666aed'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Start building block device mappings for instance. {{(pid=71308) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:53 user nova-compute[71308]: INFO os_vif [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1')
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] No VIF found with MAC fa:16:3e:d0:ca:f7, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.policy [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '267cf755a1894891aa54e8827f9ad392', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d0a80ffe2f74c6285fc4586e548872c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71308) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Start spawning the instance on the hypervisor. {{(pid=71308) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:10:53 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Creating image(s)
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "/opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "/opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:53 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.141s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG nova.network.neutron [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updated VIF entry in instance network info cache for port 9ee81da0-d1c9-443e-b4ea-73648dd076fa. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG nova.network.neutron [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating instance_info_cache with network_info: [{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cdf4e671-3d32-480a-b34c-a60b3bd864a0 req-47ae567f-9b27-456a-b25d-be5a19e0c378 service nova] Releasing lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88,backing_fmt=raw /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk 1073741824" returned: 0 in 0.050s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.149s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk. size=1073741824 {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Successfully created port: 1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG nova.virt.disk.api [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Cannot resize image /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk to a smaller size. {{(pid=71308) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lazy-loading 'migration_context' on Instance uuid dc3a90f6-84b2-4244-a29d-498da82b9a7f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Ensure instance console log exists: /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:54 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Successfully updated port: 1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "refresh_cache-dc3a90f6-84b2-4244-a29d-498da82b9a7f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquired lock "refresh_cache-dc3a90f6-84b2-4244-a29d-498da82b9a7f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received event network-changed-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.compute.manager [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Refreshing instance network info cache due to event network-changed-1cb7c282-3494-4134-a152-9b031855bc68. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] Acquiring lock "refresh_cache-dc3a90f6-84b2-4244-a29d-498da82b9a7f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Instance cache missing network info. {{(pid=71308) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.network.neutron [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Updating instance_info_cache with network_info: [{"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Releasing lock "refresh_cache-dc3a90f6-84b2-4244-a29d-498da82b9a7f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Instance network_info: |[{"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71308) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] Acquired lock "refresh_cache-dc3a90f6-84b2-4244-a29d-498da82b9a7f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.network.neutron [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Refreshing network info cache for port 1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Start _get_guest_xml network_info=[{"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:10:55 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T18:42:20Z,direct_url=<?>,disk_format='qcow2',id=09ac11b8-b53a-4bc5-8785-aad1f28737d3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='4eb9848184d546d5877b279a998af059',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T18:42:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1204816993',display_name='tempest-VolumesActionsTest-instance-1204816993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1204816993',id=47,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d0a80ffe2f74c6285fc4586e548872c',ramdisk_id='',reservation_id='r-wr3jbsfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1732698399',owner_user_name='tempest-VolumesActionsTest-1732698399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:10:54Z,user_data=None,user_id='267cf755a1894891aa54e8827f9ad392',uuid=dc3a90f6-84b2-4244-a29d-498da82b9a7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Converting VIF {"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:43,bridge_name='br-int',has_traffic_filtering=True,id=1cb7c282-3494-4134-a152-9b031855bc68,network=Network(0e425031-4fb9-4714-a2fa-c7db4dfb3180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb7c282-34') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.objects.instance [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lazy-loading 'pci_devices' on Instance uuid dc3a90f6-84b2-4244-a29d-498da82b9a7f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:10:55 user nova-compute[71308]:   <uuid>dc3a90f6-84b2-4244-a29d-498da82b9a7f</uuid>
Apr 14 19:10:55 user nova-compute[71308]:   <name>instance-0000002f</name>
Apr 14 19:10:55 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:10:55 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:10:55 user nova-compute[71308]:   <metadata>
Apr 14 19:10:55 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:10:55 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:10:55 user nova-compute[71308]:       <nova:name>tempest-VolumesActionsTest-instance-1204816993</nova:name>
Apr 14 19:10:55 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:10:55</nova:creationTime>
Apr 14 19:10:55 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:10:55 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:10:55 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:10:55 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:10:55 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:10:55 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:10:55 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:10:55 user nova-compute[71308]:       <nova:owner>
Apr 14 19:10:55 user nova-compute[71308]:         <nova:user uuid="267cf755a1894891aa54e8827f9ad392">tempest-VolumesActionsTest-1732698399-project-member</nova:user>
Apr 14 19:10:55 user nova-compute[71308]:         <nova:project uuid="2d0a80ffe2f74c6285fc4586e548872c">tempest-VolumesActionsTest-1732698399</nova:project>
Apr 14 19:10:55 user nova-compute[71308]:       </nova:owner>
Apr 14 19:10:55 user nova-compute[71308]:       <nova:root type="image" uuid="09ac11b8-b53a-4bc5-8785-aad1f28737d3"/>
Apr 14 19:10:55 user nova-compute[71308]:       <nova:ports>
Apr 14 19:10:55 user nova-compute[71308]:         <nova:port uuid="1cb7c282-3494-4134-a152-9b031855bc68">
Apr 14 19:10:55 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 19:10:55 user nova-compute[71308]:         </nova:port>
Apr 14 19:10:55 user nova-compute[71308]:       </nova:ports>
Apr 14 19:10:55 user nova-compute[71308]:     </nova:instance>
Apr 14 19:10:55 user nova-compute[71308]:   </metadata>
Apr 14 19:10:55 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:10:55 user nova-compute[71308]:     <system>
Apr 14 19:10:55 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:10:55 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:10:55 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:10:55 user nova-compute[71308]:       <entry name="serial">dc3a90f6-84b2-4244-a29d-498da82b9a7f</entry>
Apr 14 19:10:55 user nova-compute[71308]:       <entry name="uuid">dc3a90f6-84b2-4244-a29d-498da82b9a7f</entry>
Apr 14 19:10:55 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:10:55 user nova-compute[71308]:     </system>
Apr 14 19:10:55 user nova-compute[71308]:   </sysinfo>
Apr 14 19:10:55 user nova-compute[71308]:   <os>
Apr 14 19:10:55 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:10:55 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:10:55 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:10:55 user nova-compute[71308]:   </os>
Apr 14 19:10:55 user nova-compute[71308]:   <features>
Apr 14 19:10:55 user nova-compute[71308]:     <acpi/>
Apr 14 19:10:55 user nova-compute[71308]:     <apic/>
Apr 14 19:10:55 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:10:55 user nova-compute[71308]:   </features>
Apr 14 19:10:55 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:10:55 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:10:55 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:10:55 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:10:55 user nova-compute[71308]:   </clock>
Apr 14 19:10:55 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:10:55 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:10:55 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:10:55 user nova-compute[71308]:   </cpu>
Apr 14 19:10:55 user nova-compute[71308]:   <devices>
Apr 14 19:10:55 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:10:55 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:10:55 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk"/>
Apr 14 19:10:55 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:10:55 user nova-compute[71308]:     </disk>
Apr 14 19:10:55 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:10:55 user nova-compute[71308]:       <mac address="fa:16:3e:b2:47:43"/>
Apr 14 19:10:55 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:10:55 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:10:55 user nova-compute[71308]:       <target dev="tap1cb7c282-34"/>
Apr 14 19:10:55 user nova-compute[71308]:     </interface>
Apr 14 19:10:55 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:10:55 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/console.log" append="off"/>
Apr 14 19:10:55 user nova-compute[71308]:     </serial>
Apr 14 19:10:55 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:10:55 user nova-compute[71308]:     <video>
Apr 14 19:10:55 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:10:55 user nova-compute[71308]:     </video>
Apr 14 19:10:55 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:10:55 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:10:55 user nova-compute[71308]:     </rng>
Apr 14 19:10:55 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:10:55 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:10:55 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:10:55 user nova-compute[71308]:     </memballoon>
Apr 14 19:10:55 user nova-compute[71308]:   </devices>
Apr 14 19:10:55 user nova-compute[71308]: </domain>
Apr 14 19:10:55 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1204816993',display_name='tempest-VolumesActionsTest-instance-1204816993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1204816993',id=47,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d0a80ffe2f74c6285fc4586e548872c',ramdisk_id='',reservation_id='r-wr3jbsfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1732698399',owner_user_name='tempest-VolumesActionsTest-1732698399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:10:54Z,user_data=None,user_id='267cf755a1894891aa54e8827f9ad392',uuid=dc3a90f6-84b2-4244-a29d-498da82b9a7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Converting VIF {"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:43,bridge_name='br-int',has_traffic_filtering=True,id=1cb7c282-3494-4134-a152-9b031855bc68,network=Network(0e425031-4fb9-4714-a2fa-c7db4dfb3180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb7c282-34') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG os_vif [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:43,bridge_name='br-int',has_traffic_filtering=True,id=1cb7c282-3494-4134-a152-9b031855bc68,network=Network(0e425031-4fb9-4714-a2fa-c7db4dfb3180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb7c282-34') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cb7c282-34, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1cb7c282-34, col_values=(('external_ids', {'iface-id': '1cb7c282-3494-4134-a152-9b031855bc68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:47:43', 'vm-uuid': 'dc3a90f6-84b2-4244-a29d-498da82b9a7f'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:55 user nova-compute[71308]: INFO os_vif [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:43,bridge_name='br-int',has_traffic_filtering=True,id=1cb7c282-3494-4134-a152-9b031855bc68,network=Network(0e425031-4fb9-4714-a2fa-c7db4dfb3180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb7c282-34')
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:10:55 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] No VIF found with MAC fa:16:3e:b2:47:43, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:10:56 user nova-compute[71308]: DEBUG nova.network.neutron [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Updated VIF entry in instance network info cache for port 1cb7c282-3494-4134-a152-9b031855bc68. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:10:56 user nova-compute[71308]: DEBUG nova.network.neutron [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Updating instance_info_cache with network_info: [{"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:10:56 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-982eca16-5aaf-4310-adee-905779e65b6a req-381dddf0-883c-409d-bccf-65d1080930e4 service nova] Releasing lock "refresh_cache-dc3a90f6-84b2-4244-a29d-498da82b9a7f" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499457.3261914, 00ddbcca-fe9f-4417-8b6f-96671e666aed => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:10:57 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] VM Resumed (Lifecycle Event)
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:10:57 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance spawned successfully.
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] No waiting events found dispatching network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:57 user nova-compute[71308]: WARNING nova.compute.manager [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received unexpected event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance with vm_state building and task_state spawning.
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] No waiting events found dispatching network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:57 user nova-compute[71308]: WARNING nova.compute.manager [req-dbb01faa-0805-4dba-8f37-2b8c226ac56d req-94fbd5f8-5050-446a-947d-f2bc337108f2 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received unexpected event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance with vm_state building and task_state spawning.
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:57 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499457.3275769, 00ddbcca-fe9f-4417-8b6f-96671e666aed => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:10:57 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] VM Started (Lifecycle Event)
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:10:57 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:10:57 user nova-compute[71308]: INFO nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:57 user nova-compute[71308]: INFO nova.compute.manager [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Took 6.13 seconds to build instance.
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d238a8b8-1a3a-4856-9851-fd1206b2e876 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.219s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received event network-vif-plugged-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] Acquiring lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:57 user nova-compute[71308]: DEBUG nova.compute.manager [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] No waiting events found dispatching network-vif-plugged-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:57 user nova-compute[71308]: WARNING nova.compute.manager [req-c72f17a1-b4c6-4d26-8d8a-1e9d684421e3 req-e203e181-5f71-4911-b547-e9abee8a9347 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received unexpected event network-vif-plugged-1cb7c282-3494-4134-a152-9b031855bc68 for instance with vm_state building and task_state spawning.
Apr 14 19:10:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499459.3497596, dc3a90f6-84b2-4244-a29d-498da82b9a7f => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:10:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] VM Resumed (Lifecycle Event)
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:10:59 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Instance spawned successfully.
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Found default for hw_cdrom_bus of ide {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Found default for hw_disk_bus of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Found default for hw_input_bus of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Found default for hw_pointer_model of None {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Found default for hw_video_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Found default for hw_vif_model of virtio {{(pid=71308) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 19:10:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499459.3511667, dc3a90f6-84b2-4244-a29d-498da82b9a7f => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:10:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] VM Started (Lifecycle Event)
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:10:59 user nova-compute[71308]: INFO nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Took 5.54 seconds to spawn the instance on the hypervisor.
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:10:59 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received event network-vif-plugged-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] Acquiring lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:10:59 user nova-compute[71308]: DEBUG nova.compute.manager [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] No waiting events found dispatching network-vif-plugged-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:10:59 user nova-compute[71308]: WARNING nova.compute.manager [req-561ddf3d-53bd-4190-8511-08a01e933aee req-8ca009af-a1a6-4797-9060-a6a8d3570de4 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received unexpected event network-vif-plugged-1cb7c282-3494-4134-a152-9b031855bc68 for instance with vm_state building and task_state spawning.
Apr 14 19:10:59 user nova-compute[71308]: INFO nova.compute.manager [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Took 6.44 seconds to build instance.
Apr 14 19:10:59 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-ced805cc-13b1-41d5-853f-0889d155306c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.535s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:11:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:03 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499448.721704, 0fd6574c-2f67-46a9-838d-81f125c01b13 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:11:03 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] VM Stopped (Lifecycle Event)
Apr 14 19:11:03 user nova-compute[71308]: DEBUG nova.compute.manager [None req-22ad010b-7049-42b6-90d6-c5e9a14896f5 None None] [instance: 0fd6574c-2f67-46a9-838d-81f125c01b13] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:11:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:11:06 user nova-compute[71308]: DEBUG nova.compute.manager [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received event network-changed-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:11:06 user nova-compute[71308]: DEBUG nova.compute.manager [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Refreshing instance network info cache due to event network-changed-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:11:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] Acquiring lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:11:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] Acquired lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:11:06 user nova-compute[71308]: DEBUG nova.network.neutron [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Refreshing network info cache for port 1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:11:07 user nova-compute[71308]: DEBUG nova.network.neutron [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Updated VIF entry in instance network info cache for port 1ec8a1a9-4379-425f-90c0-7781c1bf8e7d. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:11:07 user nova-compute[71308]: DEBUG nova.network.neutron [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Updating instance_info_cache with network_info: [{"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:11:07 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-3f97f39d-ece2-4fd6-9a72-741be05b55ee req-4bd56c6a-b70b-4a6f-b79f-00e50cbcfbad service nova] Releasing lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received event network-changed-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Refreshing instance network info cache due to event network-changed-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] Acquiring lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] Acquired lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG nova.network.neutron [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Refreshing network info cache for port 1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "be4d9a7a-db6a-4590-9d91-7283024477f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:11:08 user nova-compute[71308]: INFO nova.compute.manager [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Terminating instance
Apr 14 19:11:08 user nova-compute[71308]: DEBUG nova.compute.manager [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG nova.network.neutron [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Updated VIF entry in instance network info cache for port 1ec8a1a9-4379-425f-90c0-7781c1bf8e7d. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG nova.network.neutron [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Updating instance_info_cache with network_info: [{"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:11:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-5361ef8a-133b-4eaa-be8f-0ded08c3d26c req-64fc3edd-a81d-4467-bba6-cbb67589314a service nova] Releasing lock "refresh_cache-be4d9a7a-db6a-4590-9d91-7283024477f8" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:11:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Instance destroyed successfully.
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.objects.instance [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'resources' on Instance uuid be4d9a7a-db6a-4590-9d91-7283024477f8 {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:09:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1086325203',display_name='tempest-TestVolumeBootPattern-server-1086325203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1086325203',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg==',key_name='tempest-TestVolumeBootPattern-875294368',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:09:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-esdx0i4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:09:26Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=be4d9a7a-db6a-4590-9d91-7283024477f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "address": "fa:16:3e:20:e3:64", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ec8a1a9-43", "ovs_interfaceid": "1ec8a1a9-4379-425f-90c0-7781c1bf8e7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:e3:64,bridge_name='br-int',has_traffic_filtering=True,id=1ec8a1a9-4379-425f-90c0-7781c1bf8e7d,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec8a1a9-43') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_vif [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:e3:64,bridge_name='br-int',has_traffic_filtering=True,id=1ec8a1a9-4379-425f-90c0-7781c1bf8e7d,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec8a1a9-43') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ec8a1a9-43, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:09 user nova-compute[71308]: INFO os_vif [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:e3:64,bridge_name='br-int',has_traffic_filtering=True,id=1ec8a1a9-4379-425f-90c0-7781c1bf8e7d,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ec8a1a9-43')
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsGLgDNB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:11:09 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[887af5ec-3282-4e7b-ad3b-fdfc87b897ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:11:09 user nova-compute[71308]: No targets found.
Apr 14 19:11:09 user nova-compute[71308]: iSNS:
Apr 14 19:11:09 user nova-compute[71308]: No targets found.
Apr 14 19:11:09 user nova-compute[71308]: STATIC:
Apr 14 19:11:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:11:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:11:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:11:09 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7
Apr 14 19:11:09 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:11:09 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:11:09 user nova-compute[71308]: FIRMWARE:
Apr 14 19:11:09 user nova-compute[71308]: No targets found.
Apr 14 19:11:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:11:09 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:11:09 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97a9ebc-6fa1-475b-890b-dca1c7ddc873]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8ad159-e9b8-486d-9a46-4e43192bd05b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:11:09 user nova-compute[71308]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 (non-flash)
Apr 14 19:11:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:11:09 user nova-compute[71308]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 (non-flash)
Apr 14 19:11:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f226c2ac160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7'): ({'sdb'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Removing single pathed devices sdb {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d93594-6e90-43e3-b751-e3c8d252f533]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf55e9be-2be5-433a-8d62-2ca4591bf8e3]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flushing IO for device /dev/sdb {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4160953-1bec-404b-bf12-0159be658a0f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40e4fcf-14da-45f3-9fd1-d6bfa2d10a31]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] SCSI volumes sdb have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4e400574', '/dev/disk/by-id/scsi-26164393130326332', '/dev/disk/by-id/scsi-1SCST_BIO4e400574-ad9102c296c1325f') {{(pid=81547) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac7b29-f253-41d6-ab34-f867e1397b0c]: (4, None) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[a740d846-92ff-4b5c-86df-28f19c7096e4]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1099b535-56f1-42af-9f22-76d5e7e58436]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7, portal: 172.16.0.220,3260]
Apr 14 19:11:09 user nova-compute[71308]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7, portal: 172.16.0.220,3260] successful.
Apr 14 19:11:09 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430ecbd6-7688-4f04-b31b-6894390ceae7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[c762c9eb-9901-4dc6-b1d7-1bc1cf8dc359]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== disconnect_volume: return (325ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:11:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Deleting instance files /opt/stack/data/nova/instances/be4d9a7a-db6a-4590-9d91-7283024477f8_del
Apr 14 19:11:09 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Deletion of /opt/stack/data/nova/instances/be4d9a7a-db6a-4590-9d91-7283024477f8_del complete
Apr 14 19:11:09 user nova-compute[71308]: INFO nova.compute.manager [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 14 19:11:09 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:11:09 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Took 0.52 seconds to deallocate network for instance.
Apr 14 19:11:09 user nova-compute[71308]: DEBUG nova.compute.manager [req-6837e7aa-3fd8-4bd9-9204-ddbda23c6ac6 req-e1caa7ef-b9f0-4c4e-9b5b-51f173926aef service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received event network-vif-deleted-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received event network-vif-unplugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Acquiring lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] No waiting events found dispatching network-vif-unplugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received event network-vif-unplugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received event network-vif-plugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Acquiring lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG nova.compute.manager [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] No waiting events found dispatching network-vif-plugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:11:10 user nova-compute[71308]: WARNING nova.compute.manager [req-15f04036-cefe-49c9-842f-ac2069d8ebc9 req-5dcf244c-857e-41e4-946c-02b5f1ca0a47 service nova] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Received unexpected event network-vif-plugged-1ec8a1a9-4379-425f-90c0-7781c1bf8e7d for instance with vm_state active and task_state deleting.
Apr 14 19:11:10 user nova-compute[71308]: INFO nova.compute.manager [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Took 0.90 seconds to detach 1 volumes for instance.
Apr 14 19:11:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:11:10 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:11:11 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:11:11 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:11:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:11:11 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Deleted allocations for instance be4d9a7a-db6a-4590-9d91-7283024477f8
Apr 14 19:11:11 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-1e789d4e-9e6f-4d3f-bafa-8e4e6eaf3a16 tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "be4d9a7a-db6a-4590-9d91-7283024477f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.137s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:11:11 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:11:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:11:16 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:11:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:11:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:11:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:11:19 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:11:19 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71308) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:11:20 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:11:21 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:11:21 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8097MB free_disk=26.25234603881836GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 935022b4-4ba7-4b34-a758-a00081240b4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance e3fa57cc-781a-402e-91fc-e4ee5640960b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance dc3a90f6-84b2-4244-a29d-498da82b9a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:11:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:11:22 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:11:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:11:23 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:11:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:11:24 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499469.0059373, be4d9a7a-db6a-4590-9d91-7283024477f8 => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:11:24 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] VM Stopped (Lifecycle Event)
Apr 14 19:11:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-3fdd8565-7c38-43e4-a706-17b9a0754286 None None] [instance: be4d9a7a-db6a-4590-9d91-7283024477f8] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:11:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:24 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:24 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:11:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:26 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:11:26 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:11:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:11:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:11:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:11:27 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updating instance_info_cache with network_info: [{"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:11:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:11:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:11:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:11:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:11:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:11:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.compute.manager [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received event network-changed-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.compute.manager [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Refreshing instance network info cache due to event network-changed-ef166576-430e-47da-b169-915c4a0cd97c. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] Acquiring lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] Acquired lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.network.neutron [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Refreshing network info cache for port ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "935022b4-4ba7-4b34-a758-a00081240b4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "935022b4-4ba7-4b34-a758-a00081240b4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:06 user nova-compute[71308]: INFO nova.compute.manager [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Terminating instance
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.network.neutron [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updated VIF entry in instance network info cache for port ef166576-430e-47da-b169-915c4a0cd97c. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.network.neutron [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updating instance_info_cache with network_info: [{"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a8c42895-8e4c-489a-ac35-4030fcd3bf63 req-cc119675-3f55-4dbc-ad82-3d94fb0c440a service nova] Releasing lock "refresh_cache-935022b4-4ba7-4b34-a758-a00081240b4c" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:12:06 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Instance destroyed successfully.
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.objects.instance [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lazy-loading 'resources' on Instance uuid 935022b4-4ba7-4b34-a758-a00081240b4c {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1288950807',display_name='tempest-TestVolumeBootPattern-server-1288950807',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1288950807',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLH6wEzI6wPr3HSI9syj/GXqtR434CPMv842eEH8Ur7optAijphl3X5nnx3wGhFElGA6ZShGSL9fAqXmiCuCFvkN96Ba8TxlbqJJF0iuZdKqgxLb5+y5P1MWLM//CZYHg==',key_name='tempest-TestVolumeBootPattern-875294368',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72d2bf68325a4a18934a8403571c24bb',ramdisk_id='',reservation_id='r-r456055f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1560263906',owner_user_name='tempest-TestVolumeBootPattern-1560263906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:07:22Z,user_data=None,user_id='fc3bed70703a49c8bdec2f50193c7f70',uuid=935022b4-4ba7-4b34-a758-a00081240b4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converting VIF {"id": "ef166576-430e-47da-b169-915c4a0cd97c", "address": "fa:16:3e:e7:51:29", "network": {"id": "bfa4fdbb-10b3-4715-9ff2-b717d052cc70", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-680744301-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72d2bf68325a4a18934a8403571c24bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef166576-43", "ovs_interfaceid": "ef166576-430e-47da-b169-915c4a0cd97c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:51:29,bridge_name='br-int',has_traffic_filtering=True,id=ef166576-430e-47da-b169-915c4a0cd97c,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef166576-43') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG os_vif [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:51:29,bridge_name='br-int',has_traffic_filtering=True,id=ef166576-430e-47da-b169-915c4a0cd97c,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef166576-43') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef166576-43, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:12:06 user nova-compute[71308]: INFO os_vif [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:51:29,bridge_name='br-int',has_traffic_filtering=True,id=ef166576-430e-47da-b169-915c4a0cd97c,network=Network(bfa4fdbb-10b3-4715-9ff2-b717d052cc70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef166576-43')
Apr 14 19:12:06 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] calling os-brick to detach iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f225416b430>, {'target_iqn': 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXLsZHeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 19:12:06 user nova-compute[71308]: WARNING os_brick.initiator.connectors.base [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 19:12:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d940a-69be-4aa4-8caf-74c934a7cbcf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 19:12:06 user nova-compute[71308]: No targets found.
Apr 14 19:12:06 user nova-compute[71308]: iSNS:
Apr 14 19:12:06 user nova-compute[71308]: No targets found.
Apr 14 19:12:06 user nova-compute[71308]: STATIC:
Apr 14 19:12:06 user nova-compute[71308]: Target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af
Apr 14 19:12:06 user nova-compute[71308]:         Portal: 172.16.0.220:3260,-1
Apr 14 19:12:06 user nova-compute[71308]:                 Iface Name: default
Apr 14 19:12:06 user nova-compute[71308]: FIRMWARE:
Apr 14 19:12:06 user nova-compute[71308]: No targets found.
Apr 14 19:12:06 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 19:12:06 user nova-compute[71308]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 19:12:06 user nova-compute[71308]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71308) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af', 0)] {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[009b784d-67ad-491e-aea6-a9f338be33d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:06 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[602e2087-f3a1-4969-80b1-12c34c9b2ebc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:12:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af (non-flash)
Apr 14 19:12:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f226c2f80d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af'): ({'sdc'}, set())}) {{(pid=71308) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Removing single pathed devices sdc {{(pid=71308) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9caabb4-c104-4019-a7a5-2450991e35cd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb22f1b2-2110-426f-a051-ee23aba11535]: (4, ('ok\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Flushing IO for device /dev/sdc {{(pid=71308) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d509374-f2e0-4aa9-830f-85c866b3c13f]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71308) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[8796c765-e5f6-46ef-b80b-ef213dca9dda]: (4, ('1', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.linuxscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] SCSI volumes sdc have been removed. {{(pid=71308) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO560487d3-e710d96f04895ae3', '/dev/disk/by-id/scsi-26537313064393666', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_560487d3') {{(pid=81547) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45a349a-f9ac-4fe6-aaed-9a29c4f5cbd8]: (4, None) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af')] {{(pid=71308) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[1412bc20-fe1b-4f39-9cf2-142600f8ae29]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --logout {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0a74a1-ca80-403f-a027-bffb2319e792]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260]
Apr 14 19:12:07 user nova-compute[71308]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af, portal: 172.16.0.220,3260] successful.
Apr 14 19:12:07 user nova-compute[71308]:  stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op delete {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:126e30a2-deeb-433e-a8b5-e9970ffc15af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81547) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b843e6a-56dc-4a37-9407-55f944a10162]: (4, ('', '')) {{(pid=81547) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71308) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.base [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] <== disconnect_volume: return (299ms) None {{(pid=71308) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Disconnected iSCSI Volume {{(pid=71308) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 19:12:07 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Deleting instance files /opt/stack/data/nova/instances/935022b4-4ba7-4b34-a758-a00081240b4c_del
Apr 14 19:12:07 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Deletion of /opt/stack/data/nova/instances/935022b4-4ba7-4b34-a758-a00081240b4c_del complete
Apr 14 19:12:07 user nova-compute[71308]: INFO nova.compute.manager [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 14 19:12:07 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:12:07 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received event network-vif-unplugged-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Acquiring lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] No waiting events found dispatching network-vif-unplugged-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received event network-vif-unplugged-ef166576-430e-47da-b169-915c4a0cd97c for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received event network-vif-plugged-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Acquiring lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] Lock "935022b4-4ba7-4b34-a758-a00081240b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] No waiting events found dispatching network-vif-plugged-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:12:08 user nova-compute[71308]: WARNING nova.compute.manager [req-ed8420aa-f7d8-45ff-95d1-ca4bc40333b4 req-ef706788-311c-44c2-97ac-a0ac15ba3d0f service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received unexpected event network-vif-plugged-ef166576-430e-47da-b169-915c4a0cd97c for instance with vm_state active and task_state deleting.
Apr 14 19:12:08 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:12:08 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Took 1.07 seconds to deallocate network for instance.
Apr 14 19:12:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Received event network-vif-deleted-ef166576-430e-47da-b169-915c4a0cd97c {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:08 user nova-compute[71308]: INFO nova.compute.manager [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Neutron deleted interface ef166576-430e-47da-b169-915c4a0cd97c; detaching it from the instance and deleting it from the info cache
Apr 14 19:12:08 user nova-compute[71308]: DEBUG nova.network.neutron [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:12:08 user nova-compute[71308]: DEBUG nova.compute.manager [req-9d14a681-aaf6-46ff-8056-269456d214b6 req-67f4aa5c-723d-40be-a51e-e57167c1e369 service nova] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Detach interface failed, port_id=ef166576-430e-47da-b169-915c4a0cd97c, reason: Instance 935022b4-4ba7-4b34-a758-a00081240b4c could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 19:12:09 user nova-compute[71308]: INFO nova.compute.manager [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 19:12:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:09 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:12:09 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:12:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:09 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Deleted allocations for instance 935022b4-4ba7-4b34-a758-a00081240b4c
Apr 14 19:12:09 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-7c9c3476-4964-42f4-bd24-6d774c5326de tempest-TestVolumeBootPattern-1560263906 tempest-TestVolumeBootPattern-1560263906-project-member] Lock "935022b4-4ba7-4b34-a758-a00081240b4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.428s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:13 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "e3fa57cc-781a-402e-91fc-e4ee5640960b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:14 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:14 user nova-compute[71308]: INFO nova.compute.manager [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Terminating instance
Apr 14 19:12:14 user nova-compute[71308]: DEBUG nova.compute.manager [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:12:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG nova.compute.manager [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received event network-vif-unplugged-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] Acquiring lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG nova.compute.manager [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] No waiting events found dispatching network-vif-unplugged-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG nova.compute.manager [req-1be9a93d-c47a-48bc-beee-84a1d5587403 req-cacb89e6-bcd7-4316-8841-4f81b7f73e7c service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received event network-vif-unplugged-2446f800-78b9-4e6d-80cb-23be097676bd for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Instance destroyed successfully.
Apr 14 19:12:15 user nova-compute[71308]: DEBUG nova.objects.instance [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lazy-loading 'resources' on Instance uuid e3fa57cc-781a-402e-91fc-e4ee5640960b {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2040926824',display_name='tempest-VolumesActionsTest-instance-2040926824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2040926824',id=45,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f71b0490e5a4d3b9300dc510b936a44',ramdisk_id='',reservation_id='r-w2emcmxt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1832164482',owner_user_name='tempest-VolumesActionsTest-1832164482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:10:32Z,user_data=None,user_id='0b1b6efb65b541ef992b66d9d06bd03f',uuid=e3fa57cc-781a-402e-91fc-e4ee5640960b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converting VIF {"id": "2446f800-78b9-4e6d-80cb-23be097676bd", "address": "fa:16:3e:bc:07:e4", "network": {"id": "d351be52-944c-4631-9649-ce34a967f20a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-781881907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5f71b0490e5a4d3b9300dc510b936a44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2446f800-78", "ovs_interfaceid": "2446f800-78b9-4e6d-80cb-23be097676bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=2446f800-78b9-4e6d-80cb-23be097676bd,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2446f800-78') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG os_vif [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=2446f800-78b9-4e6d-80cb-23be097676bd,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2446f800-78') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2446f800-78, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:12:15 user nova-compute[71308]: INFO os_vif [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:07:e4,bridge_name='br-int',has_traffic_filtering=True,id=2446f800-78b9-4e6d-80cb-23be097676bd,network=Network(d351be52-944c-4631-9649-ce34a967f20a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2446f800-78')
Apr 14 19:12:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Deleting instance files /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b_del
Apr 14 19:12:15 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Deletion of /opt/stack/data/nova/instances/e3fa57cc-781a-402e-91fc-e4ee5640960b_del complete
Apr 14 19:12:15 user nova-compute[71308]: INFO nova.compute.manager [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 14 19:12:15 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:12:15 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:12:16 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:12:16 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Took 0.46 seconds to deallocate network for instance.
Apr 14 19:12:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received event network-vif-deleted-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:16 user nova-compute[71308]: INFO nova.compute.manager [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Neutron deleted interface 2446f800-78b9-4e6d-80cb-23be097676bd; detaching it from the instance and deleting it from the info cache
Apr 14 19:12:16 user nova-compute[71308]: DEBUG nova.network.neutron [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:12:16 user nova-compute[71308]: DEBUG nova.compute.manager [req-65d690ec-2660-4eff-9da0-2da2aa0d311d req-3fd30160-47ba-4848-ad4b-67f0be145da4 service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Detach interface failed, port_id=2446f800-78b9-4e6d-80cb-23be097676bd, reason: Instance e3fa57cc-781a-402e-91fc-e4ee5640960b could not be found. {{(pid=71308) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 19:12:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:16 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:12:16 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:12:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:16 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Deleted allocations for instance e3fa57cc-781a-402e-91fc-e4ee5640960b
Apr 14 19:12:16 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-baac3757-20fd-47b3-a0b1-3df8185598f9 tempest-VolumesActionsTest-1832164482 tempest-VolumesActionsTest-1832164482-project-member] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.484s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received event network-vif-plugged-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] Acquiring lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:17 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] Lock "e3fa57cc-781a-402e-91fc-e4ee5640960b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:17 user nova-compute[71308]: DEBUG nova.compute.manager [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] No waiting events found dispatching network-vif-plugged-2446f800-78b9-4e6d-80cb-23be097676bd {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:12:17 user nova-compute[71308]: WARNING nova.compute.manager [req-6fab3356-9b45-4a0e-934f-51cf7fb2f938 req-4cfa931f-fd59-46e0-8d1a-2d22af17c29f service nova] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Received unexpected event network-vif-plugged-2446f800-78b9-4e6d-80cb-23be097676bd for instance with vm_state deleted and task_state None.
Apr 14 19:12:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:21 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499526.8886287, 935022b4-4ba7-4b34-a758-a00081240b4c => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:12:21 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] VM Stopped (Lifecycle Event)
Apr 14 19:12:21 user nova-compute[71308]: DEBUG nova.compute.manager [None req-5352efd0-0ed6-4171-9b71-3aacf6e03b3d None None] [instance: 935022b4-4ba7-4b34-a758-a00081240b4c] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:12:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:12:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:23 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:12:23 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8456MB free_disk=26.268383026123047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance dc3a90f6-84b2-4244-a29d-498da82b9a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing inventories for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating ProviderTree inventory for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating inventory in ProviderTree for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing aggregate associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, aggregates: None {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing trait associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:12:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:24 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:24 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:24 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:12:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:12:25 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:26 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:27 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:28 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:12:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 19:12:30 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499535.4704094, e3fa57cc-781a-402e-91fc-e4ee5640960b => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:12:30 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] VM Stopped (Lifecycle Event)
Apr 14 19:12:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-7ad7d37c-a10e-43dd-9ecb-c286f83bdf82 None None] [instance: e3fa57cc-781a-402e-91fc-e4ee5640960b] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:12:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:12:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:12:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:12:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:12:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:31 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:31 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 19:12:31 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] There are 0 instances to clean {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 19:12:34 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-changed-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG nova.compute.manager [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Refreshing instance network info cache due to event network-changed-9ee81da0-d1c9-443e-b4ea-73648dd076fa. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] Acquiring lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] Acquired lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Refreshing network info cache for port 9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updated VIF entry in instance network info cache for port 9ee81da0-d1c9-443e-b4ea-73648dd076fa. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating instance_info_cache with network_info: [{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-9c8f5af5-eec5-4e8d-8d9d-cfed387b50aa req-1f39b3df-5a58-46e0-81f0-b4a8a3ec9d4e service nova] Releasing lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:42 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71308) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 19:12:43 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:12:44 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:45 user nova-compute[71308]: INFO nova.compute.manager [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Shelving
Apr 14 19:12:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-unplugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] No waiting events found dispatching network-vif-unplugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:12:46 user nova-compute[71308]: WARNING nova.compute.manager [req-a2ebbfd5-98b8-49c5-aff5-d47b61f310ab req-6378f6a1-1051-4026-ad63-82dbac89e25d service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received unexpected event network-vif-unplugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance with vm_state active and task_state shelving.
Apr 14 19:12:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance destroyed successfully.
Apr 14 19:12:46 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Beginning cold snapshot process
Apr 14 19:12:46 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 19:12:46 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk /opt/stack/data/nova/instances/snapshots/tmp6xt2s5pl/efd224eeae2245bea5e38bc009ecec73 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:12:47 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk /opt/stack/data/nova/instances/snapshots/tmp6xt2s5pl/efd224eeae2245bea5e38bc009ecec73" returned: 0 in 0.589s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:12:47 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Snapshot extracted, beginning image upload
Apr 14 19:12:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:48 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:48 user nova-compute[71308]: DEBUG nova.compute.manager [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] No waiting events found dispatching network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:12:48 user nova-compute[71308]: WARNING nova.compute.manager [req-300663f2-81ce-4221-b962-a9bf8ce9976e req-ed8fd3d6-dbdd-4367-afe7-d5448f422381 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received unexpected event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 19:12:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:49 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Snapshot image upload complete
Apr 14 19:12:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:12:49 user nova-compute[71308]: INFO nova.compute.manager [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Shelve offloading
Apr 14 19:12:49 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance destroyed successfully.
Apr 14 19:12:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:12:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:12:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquired lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:12:49 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG nova.network.neutron [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating instance_info_cache with network_info: [{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Releasing lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:50 user nova-compute[71308]: INFO nova.compute.manager [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Terminating instance
Apr 14 19:12:50 user nova-compute[71308]: DEBUG nova.compute.manager [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:12:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance destroyed successfully.
Apr 14 19:12:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'resources' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1565912159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1565912159',id=46,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlIIFLFsgmEE/cdWpQjb+8JZ3zZZK7ioNqf8TeFKeaiDVMl2nNhJJg/zxBKMinLXJGljsSokaNaV14gZ/dazOcADVQr2+0DMzXCDvHQwDPG9oG9sf5EXCJoMu5yIEfKVw==',key_name='tempest-keypair-1714568544',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:10:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-594lfxgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member',shelved_at='2023-04-14T19:12:49.662688',shelved_host='user',shelved_image_id='74914476-4f1d-4598-9eb3-37f6bad7dcda'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=00ddbcca-fe9f-4417-8b6f-96671e666aed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG os_vif [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ee81da0-d1, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-changed-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG nova.compute.manager [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Refreshing instance network info cache due to event network-changed-9ee81da0-d1c9-443e-b4ea-73648dd076fa. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] Acquiring lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] Acquired lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG nova.network.neutron [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Refreshing network info cache for port 9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:12:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:50 user nova-compute[71308]: INFO os_vif [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1')
Apr 14 19:12:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Deleting instance files /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed_del
Apr 14 19:12:50 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Deletion of /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed_del complete
Apr 14 19:12:51 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Deleted allocations for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed
Apr 14 19:12:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.objects.instance [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'numa_topology' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received event network-vif-unplugged-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] Acquiring lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] No waiting events found dispatching network-vif-unplugged-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.compute.manager [req-2cfe52f6-6975-4e8c-b31e-e8535f7af28f req-19aeadea-c9cc-446f-afb4-7ef7743e1987 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received event network-vif-unplugged-1cb7c282-3494-4134-a152-9b031855bc68 for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Instance destroyed successfully.
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.objects.instance [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lazy-loading 'resources' on Instance uuid dc3a90f6-84b2-4244-a29d-498da82b9a7f {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T19:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1204816993',display_name='tempest-VolumesActionsTest-instance-1204816993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1204816993',id=47,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:10:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d0a80ffe2f74c6285fc4586e548872c',ramdisk_id='',reservation_id='r-wr3jbsfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1732698399',owner_user_name='tempest-VolumesActionsTest-1732698399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:11:00Z,user_data=None,user_id='267cf755a1894891aa54e8827f9ad392',uuid=dc3a90f6-84b2-4244-a29d-498da82b9a7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Converting VIF {"id": "1cb7c282-3494-4134-a152-9b031855bc68", "address": "fa:16:3e:b2:47:43", "network": {"id": "0e425031-4fb9-4714-a2fa-c7db4dfb3180", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1851771107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2d0a80ffe2f74c6285fc4586e548872c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb7c282-34", "ovs_interfaceid": "1cb7c282-3494-4134-a152-9b031855bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:43,bridge_name='br-int',has_traffic_filtering=True,id=1cb7c282-3494-4134-a152-9b031855bc68,network=Network(0e425031-4fb9-4714-a2fa-c7db4dfb3180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb7c282-34') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG os_vif [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:43,bridge_name='br-int',has_traffic_filtering=True,id=1cb7c282-3494-4134-a152-9b031855bc68,network=Network(0e425031-4fb9-4714-a2fa-c7db4dfb3180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb7c282-34') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cb7c282-34, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:12:51 user nova-compute[71308]: INFO os_vif [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:47:43,bridge_name='br-int',has_traffic_filtering=True,id=1cb7c282-3494-4134-a152-9b031855bc68,network=Network(0e425031-4fb9-4714-a2fa-c7db4dfb3180),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb7c282-34')
Apr 14 19:12:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Deleting instance files /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f_del
Apr 14 19:12:51 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Deletion of /opt/stack/data/nova/instances/dc3a90f6-84b2-4244-a29d-498da82b9a7f_del complete
Apr 14 19:12:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-d50f511f-8a84-487b-a556-0fcec0358c8e tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.600s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:51 user nova-compute[71308]: INFO nova.compute.manager [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 14 19:12:51 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updated VIF entry in instance network info cache for port 9ee81da0-d1c9-443e-b4ea-73648dd076fa. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG nova.network.neutron [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating instance_info_cache with network_info: [{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:12:51 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-32ea81ff-1e4f-43ac-af6a-b1a0bcf1a7ad req-eb81dc12-5062-4dfe-9e78-26ffe3b5d0bb service nova] Releasing lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:12:52 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:12:52 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Took 0.58 seconds to deallocate network for instance.
Apr 14 19:12:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:52 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:12:52 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:12:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:52 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Deleted allocations for instance dc3a90f6-84b2-4244-a29d-498da82b9a7f
Apr 14 19:12:52 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-2a175166-49e9-4de7-81b0-edf684ed947c tempest-VolumesActionsTest-1732698399 tempest-VolumesActionsTest-1732698399-project-member] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.586s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received event network-vif-plugged-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] Acquiring lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:12:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:12:53 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] Lock "dc3a90f6-84b2-4244-a29d-498da82b9a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:12:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] No waiting events found dispatching network-vif-plugged-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:12:53 user nova-compute[71308]: WARNING nova.compute.manager [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received unexpected event network-vif-plugged-1cb7c282-3494-4134-a152-9b031855bc68 for instance with vm_state deleted and task_state None.
Apr 14 19:12:53 user nova-compute[71308]: DEBUG nova.compute.manager [req-deaa22a2-815b-41e7-818c-af3371fd2bab req-7bc3f1ec-baad-409e-af36-fc25be8a4d34 service nova] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Received event network-vif-deleted-1cb7c282-3494-4134-a152-9b031855bc68 {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:12:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:12:59 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:13:00 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:13:01 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499566.666023, 00ddbcca-fe9f-4417-8b6f-96671e666aed => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:13:01 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] VM Stopped (Lifecycle Event)
Apr 14 19:13:01 user nova-compute[71308]: DEBUG nova.compute.manager [None req-fe4d2f14-8476-4448-bdac-bb36ea5f5c87 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:13:03 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:13:06 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499571.3841074, dc3a90f6-84b2-4244-a29d-498da82b9a7f => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:13:06 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] VM Stopped (Lifecycle Event)
Apr 14 19:13:06 user nova-compute[71308]: DEBUG nova.compute.manager [None req-bf59a425-e4f2-4293-bcff-8ac41480f352 None None] [instance: dc3a90f6-84b2-4244-a29d-498da82b9a7f] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:13:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:13:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:13:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:13:14 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:13:15 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:13:18 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:19 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:13:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:13:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:13:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:13:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:13:23 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:13:23 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:13:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8689MB free_disk=25.701744079589844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:13:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:13:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:13:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:13:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:13:23 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:13:23 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:13:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:13:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:13:25 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:25 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:13:25 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:13:28 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:29 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:13:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:13:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 19:13:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 19:13:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:13:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:13:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:13:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:13:51 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:13:56 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:14:01 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:14:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:14:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:14:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:14:06 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:11 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:15 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:16 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:14:20 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:20 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:21 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:14:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:14:22 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:14:22 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:14:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=26.25815200805664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:14:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:14:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:14:22 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:14:22 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:14:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:14:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:25 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:25 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:25 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:14:26 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:14:27 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:28 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:29 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:14:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 19:14:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 19:14:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:14:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:14:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:14:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:14:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:14:36 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:14:37 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:14:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:39 user nova-compute[71308]: INFO nova.compute.manager [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Unshelving
Apr 14 19:14:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:39 user nova-compute[71308]: DEBUG nova.objects.instance [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'pci_requests' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:14:39 user nova-compute[71308]: DEBUG nova.objects.instance [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'numa_topology' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:14:39 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71308) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 19:14:39 user nova-compute[71308]: INFO nova.compute.claims [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Claim successful on node user
Apr 14 19:14:39 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:14:39 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:14:39 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:39 user nova-compute[71308]: INFO nova.network.neutron [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating port 9ee81da0-d1c9-443e-b4ea-73648dd076fa with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 19:14:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:14:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquired lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:14:40 user nova-compute[71308]: DEBUG nova.network.neutron [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Building network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 19:14:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-changed-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:14:40 user nova-compute[71308]: DEBUG nova.compute.manager [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Refreshing instance network info cache due to event network-changed-9ee81da0-d1c9-443e-b4ea-73648dd076fa. {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 19:14:40 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] Acquiring lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG nova.network.neutron [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating instance_info_cache with network_info: [{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Releasing lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Creating instance directory {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 19:14:41 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Creating image(s)
Apr 14 19:14:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG nova.objects.instance [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] Acquired lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG nova.network.neutron [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Refreshing network info cache for port 9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "d6e615f9438730ea207a9f79deef800a62882f27" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "d6e615f9438730ea207a9f79deef800a62882f27" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:41 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27.part --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updated VIF entry in instance network info cache for port 9ee81da0-d1c9-443e-b4ea-73648dd076fa. {{(pid=71308) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG nova.network.neutron [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating instance_info_cache with network_info: [{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-6ba0dcd6-d63e-4100-a9aa-ddbf1a81aa42 req-1fd18696-bf9e-40f6-ae5e-da0921f57a2b service nova] Releasing lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27.part --force-share --output=json" returned: 0 in 0.301s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG nova.virt.images [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] 74914476-4f1d-4598-9eb3-37f6bad7dcda was qcow2, converting to raw {{(pid=71308) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG nova.privsep.utils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71308) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27.part /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27.converted {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27.part /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27.converted" returned: 0 in 0.161s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27.converted --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "d6e615f9438730ea207a9f79deef800a62882f27" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.441s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27 --force-share --output=json" returned: 0 in 0.142s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "d6e615f9438730ea207a9f79deef800a62882f27" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "d6e615f9438730ea207a9f79deef800a62882f27" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:42 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:14:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27 --force-share --output=json" returned: 0 in 0.137s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:14:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27,backing_fmt=raw /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk 1073741824 {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:14:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27,backing_fmt=raw /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk 1073741824" returned: 0 in 0.049s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:14:43 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "d6e615f9438730ea207a9f79deef800a62882f27" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:14:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6e615f9438730ea207a9f79deef800a62882f27 --force-share --output=json" returned: 0 in 0.133s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:14:43 user nova-compute[71308]: DEBUG nova.objects.instance [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'migration_context' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:14:43 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Rebasing disk image.
Apr 14 19:14:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:14:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:14:43 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 -F raw /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2a9e3cafffd105bec9bb9bd19e0ad0eb3c5b6b88 -F raw /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk" returned: 0 in 1.802s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Created local disks {{(pid=71308) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Ensure instance console log exists: /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/console.log {{(pid=71308) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Start _get_guest_xml network_info=[{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c98565c72d115aba7cf4a35691e72718',container_format='bare',created_at=2023-04-14T19:12:46Z,direct_url=<?>,disk_format='qcow2',id=74914476-4f1d-4598-9eb3-37f6bad7dcda,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1565912159-shelved',owner='ebb0956418bd462c84e1392a74b5ae2e',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T19:12:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'image_id': '09ac11b8-b53a-4bc5-8785-aad1f28737d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 19:14:45 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:14:45 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71308) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T18:43:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c98565c72d115aba7cf4a35691e72718',container_format='bare',created_at=2023-04-14T19:12:46Z,direct_url=<?>,disk_format='qcow2',id=74914476-4f1d-4598-9eb3-37f6bad7dcda,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1565912159-shelved',owner='ebb0956418bd462c84e1392a74b5ae2e',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T19:12:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image limits 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Flavor pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Image pref 0:0:0 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Got 1 possible topologies {{(pid=71308) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.hardware [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71308) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.objects.instance [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T19:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1565912159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1565912159',id=46,image_ref='74914476-4f1d-4598-9eb3-37f6bad7dcda',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1714568544',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:10:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-594lfxgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member',shelved_at='2023-04-14T19:12:49.662688',shelved_host='user',shelved_image_id='74914476-4f1d-4598-9eb3-37f6bad7dcda'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=00ddbcca-fe9f-4417-8b6f-96671e666aed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71308) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.objects.instance [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'pci_devices' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] End _get_guest_xml xml=<domain type="kvm">
Apr 14 19:14:45 user nova-compute[71308]:   <uuid>00ddbcca-fe9f-4417-8b6f-96671e666aed</uuid>
Apr 14 19:14:45 user nova-compute[71308]:   <name>instance-0000002e</name>
Apr 14 19:14:45 user nova-compute[71308]:   <memory>131072</memory>
Apr 14 19:14:45 user nova-compute[71308]:   <vcpu>1</vcpu>
Apr 14 19:14:45 user nova-compute[71308]:   <metadata>
Apr 14 19:14:45 user nova-compute[71308]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 19:14:45 user nova-compute[71308]:       <nova:package version="0.0.0"/>
Apr 14 19:14:45 user nova-compute[71308]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1565912159</nova:name>
Apr 14 19:14:45 user nova-compute[71308]:       <nova:creationTime>2023-04-14 19:14:45</nova:creationTime>
Apr 14 19:14:45 user nova-compute[71308]:       <nova:flavor name="m1.nano">
Apr 14 19:14:45 user nova-compute[71308]:         <nova:memory>128</nova:memory>
Apr 14 19:14:45 user nova-compute[71308]:         <nova:disk>1</nova:disk>
Apr 14 19:14:45 user nova-compute[71308]:         <nova:swap>0</nova:swap>
Apr 14 19:14:45 user nova-compute[71308]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 19:14:45 user nova-compute[71308]:         <nova:vcpus>1</nova:vcpus>
Apr 14 19:14:45 user nova-compute[71308]:       </nova:flavor>
Apr 14 19:14:45 user nova-compute[71308]:       <nova:owner>
Apr 14 19:14:45 user nova-compute[71308]:         <nova:user uuid="716e5499c6eb483e9c88fd25606018d9">tempest-AttachVolumeShelveTestJSON-1405261713-project-member</nova:user>
Apr 14 19:14:45 user nova-compute[71308]:         <nova:project uuid="ebb0956418bd462c84e1392a74b5ae2e">tempest-AttachVolumeShelveTestJSON-1405261713</nova:project>
Apr 14 19:14:45 user nova-compute[71308]:       </nova:owner>
Apr 14 19:14:45 user nova-compute[71308]:       <nova:root type="image" uuid="74914476-4f1d-4598-9eb3-37f6bad7dcda"/>
Apr 14 19:14:45 user nova-compute[71308]:       <nova:ports>
Apr 14 19:14:45 user nova-compute[71308]:         <nova:port uuid="9ee81da0-d1c9-443e-b4ea-73648dd076fa">
Apr 14 19:14:45 user nova-compute[71308]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 19:14:45 user nova-compute[71308]:         </nova:port>
Apr 14 19:14:45 user nova-compute[71308]:       </nova:ports>
Apr 14 19:14:45 user nova-compute[71308]:     </nova:instance>
Apr 14 19:14:45 user nova-compute[71308]:   </metadata>
Apr 14 19:14:45 user nova-compute[71308]:   <sysinfo type="smbios">
Apr 14 19:14:45 user nova-compute[71308]:     <system>
Apr 14 19:14:45 user nova-compute[71308]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 19:14:45 user nova-compute[71308]:       <entry name="product">OpenStack Nova</entry>
Apr 14 19:14:45 user nova-compute[71308]:       <entry name="version">0.0.0</entry>
Apr 14 19:14:45 user nova-compute[71308]:       <entry name="serial">00ddbcca-fe9f-4417-8b6f-96671e666aed</entry>
Apr 14 19:14:45 user nova-compute[71308]:       <entry name="uuid">00ddbcca-fe9f-4417-8b6f-96671e666aed</entry>
Apr 14 19:14:45 user nova-compute[71308]:       <entry name="family">Virtual Machine</entry>
Apr 14 19:14:45 user nova-compute[71308]:     </system>
Apr 14 19:14:45 user nova-compute[71308]:   </sysinfo>
Apr 14 19:14:45 user nova-compute[71308]:   <os>
Apr 14 19:14:45 user nova-compute[71308]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 19:14:45 user nova-compute[71308]:     <boot dev="hd"/>
Apr 14 19:14:45 user nova-compute[71308]:     <smbios mode="sysinfo"/>
Apr 14 19:14:45 user nova-compute[71308]:   </os>
Apr 14 19:14:45 user nova-compute[71308]:   <features>
Apr 14 19:14:45 user nova-compute[71308]:     <acpi/>
Apr 14 19:14:45 user nova-compute[71308]:     <apic/>
Apr 14 19:14:45 user nova-compute[71308]:     <vmcoreinfo/>
Apr 14 19:14:45 user nova-compute[71308]:   </features>
Apr 14 19:14:45 user nova-compute[71308]:   <clock offset="utc">
Apr 14 19:14:45 user nova-compute[71308]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 19:14:45 user nova-compute[71308]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 19:14:45 user nova-compute[71308]:     <timer name="hpet" present="no"/>
Apr 14 19:14:45 user nova-compute[71308]:   </clock>
Apr 14 19:14:45 user nova-compute[71308]:   <cpu mode="custom" match="exact">
Apr 14 19:14:45 user nova-compute[71308]:     <model>Nehalem</model>
Apr 14 19:14:45 user nova-compute[71308]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 19:14:45 user nova-compute[71308]:   </cpu>
Apr 14 19:14:45 user nova-compute[71308]:   <devices>
Apr 14 19:14:45 user nova-compute[71308]:     <disk type="file" device="disk">
Apr 14 19:14:45 user nova-compute[71308]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 19:14:45 user nova-compute[71308]:       <source file="/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk"/>
Apr 14 19:14:45 user nova-compute[71308]:       <target dev="vda" bus="virtio"/>
Apr 14 19:14:45 user nova-compute[71308]:     </disk>
Apr 14 19:14:45 user nova-compute[71308]:     <interface type="ethernet">
Apr 14 19:14:45 user nova-compute[71308]:       <mac address="fa:16:3e:d0:ca:f7"/>
Apr 14 19:14:45 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:14:45 user nova-compute[71308]:       <mtu size="1442"/>
Apr 14 19:14:45 user nova-compute[71308]:       <target dev="tap9ee81da0-d1"/>
Apr 14 19:14:45 user nova-compute[71308]:     </interface>
Apr 14 19:14:45 user nova-compute[71308]:     <serial type="pty">
Apr 14 19:14:45 user nova-compute[71308]:       <log file="/opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/console.log" append="off"/>
Apr 14 19:14:45 user nova-compute[71308]:     </serial>
Apr 14 19:14:45 user nova-compute[71308]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 19:14:45 user nova-compute[71308]:     <video>
Apr 14 19:14:45 user nova-compute[71308]:       <model type="virtio"/>
Apr 14 19:14:45 user nova-compute[71308]:     </video>
Apr 14 19:14:45 user nova-compute[71308]:     <rng model="virtio">
Apr 14 19:14:45 user nova-compute[71308]:       <backend model="random">/dev/urandom</backend>
Apr 14 19:14:45 user nova-compute[71308]:     </rng>
Apr 14 19:14:45 user nova-compute[71308]:     <controller type="usb" index="0" model="none"/>
Apr 14 19:14:45 user nova-compute[71308]:     <memballoon model="virtio">
Apr 14 19:14:45 user nova-compute[71308]:       <stats period="10"/>
Apr 14 19:14:45 user nova-compute[71308]:     </memballoon>
Apr 14 19:14:45 user nova-compute[71308]:   </devices>
Apr 14 19:14:45 user nova-compute[71308]: </domain>
Apr 14 19:14:45 user nova-compute[71308]:  {{(pid=71308) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T19:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1565912159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1565912159',id=46,image_ref='74914476-4f1d-4598-9eb3-37f6bad7dcda',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1714568544',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:10:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-594lfxgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member',shelved_at='2023-04-14T19:12:49.662688',shelved_host='user',shelved_image_id='74914476-4f1d-4598-9eb3-37f6bad7dcda'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T19:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=00ddbcca-fe9f-4417-8b6f-96671e666aed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG os_vif [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ee81da0-d1, may_exist=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9ee81da0-d1, col_values=(('external_ids', {'iface-id': '9ee81da0-d1c9-443e-b4ea-73648dd076fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:ca:f7', 'vm-uuid': '00ddbcca-fe9f-4417-8b6f-96671e666aed'}),)) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:45 user nova-compute[71308]: INFO os_vif [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1')
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] No BDM found with device name vda, not building metadata. {{(pid=71308) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 19:14:45 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] No VIF found with MAC fa:16:3e:d0:ca:f7, not building metadata {{(pid=71308) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:46 user nova-compute[71308]: DEBUG nova.compute.manager [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] No waiting events found dispatching network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:14:46 user nova-compute[71308]: WARNING nova.compute.manager [req-cd24560d-690f-4dc2-8a3f-306986554cf4 req-e13436c3-5b81-463f-b840-ace7b7d6f88a service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received unexpected event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 19:14:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:47 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.compute.manager [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] No waiting events found dispatching network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:14:49 user nova-compute[71308]: WARNING nova.compute.manager [req-43c7e796-b2a9-4527-b424-4f871c328225 req-5ff2a508-8d6b-46f7-beaa-ef70c564c781 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received unexpected event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499689.0361395, 00ddbcca-fe9f-4417-8b6f-96671e666aed => Resumed> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:14:49 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] VM Resumed (Lifecycle Event)
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance event wait completed in 0 seconds for  {{(pid=71308) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.virt.libvirt.driver [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Guest created on hypervisor {{(pid=71308) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 19:14:49 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance spawned successfully.
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:49 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.virt.driver [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] Emitting event <LifecycleEvent: 1681499689.0379572, 00ddbcca-fe9f-4417-8b6f-96671e666aed => Started> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:14:49 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] VM Started (Lifecycle Event)
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71308) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 19:14:49 user nova-compute[71308]: INFO nova.compute.manager [None req-d79adf83-d700-4afc-ac10-2e1256ac3663 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 19:14:49 user nova-compute[71308]: DEBUG nova.compute.manager [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:14:49 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-85c6b822-1f2a-47ca-bb17-6d7983da1aea tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.822s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:14:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:54 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:14:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:15:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:15:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:15:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:15:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:04 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:15:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:15:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:15:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:15:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:15 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:15:19 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:20 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:15:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:15:21 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:15:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:15:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:15:21 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:15:21 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:15:22 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:15:22 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:15:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8710MB free_disk=26.238780975341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:15:22 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:15:23 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:15:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:15:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:15:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:28 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:15:28 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:15:28 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:15:28 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:15:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:15:30 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:15:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:15:30 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 19:15:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 19:15:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquired lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 19:15:31 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Forcefully refreshing network info cache for instance {{(pid=71308) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 19:15:31 user nova-compute[71308]: DEBUG nova.objects.instance [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lazy-loading 'info_cache' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:15:31 user nova-compute[71308]: DEBUG nova.network.neutron [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating instance_info_cache with network_info: [{"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:15:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Releasing lock "refresh_cache-00ddbcca-fe9f-4417-8b6f-96671e666aed" {{(pid=71308) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 19:15:31 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updated the network info_cache for instance {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 19:15:31 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:15:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:15:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:15:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:15:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:15:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:15:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:15:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:15:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:15:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:16:09 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:16:15 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:16:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:16:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:16:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:16:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:16:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:16:22 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:16:22 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG oslo_concurrency.processutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71308) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 19:16:23 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:16:23 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:16:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=26.238174438476562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Instance 00ddbcca-fe9f-4417-8b6f-96671e666aed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71308) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:16:23 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:16:24 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:16:27 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:27 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:16:28 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:16:29 user nova-compute[71308]: INFO nova.compute.manager [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Terminating instance
Apr 14 19:16:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Start destroying the instance on the hypervisor. {{(pid=71308) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-unplugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] No waiting events found dispatching network-vif-unplugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG nova.compute.manager [req-4df0d866-18c4-44e0-b564-355d3fc558d8 req-338e3bd5-2a3f-4598-8f1e-7a025a9bc263 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-unplugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance with task_state deleting. {{(pid=71308) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:29 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Instance destroyed successfully.
Apr 14 19:16:30 user nova-compute[71308]: DEBUG nova.objects.instance [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lazy-loading 'resources' on Instance uuid 00ddbcca-fe9f-4417-8b6f-96671e666aed {{(pid=71308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG nova.virt.libvirt.vif [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T19:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1565912159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1565912159',id=46,image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlIIFLFsgmEE/cdWpQjb+8JZ3zZZK7ioNqf8TeFKeaiDVMl2nNhJJg/zxBKMinLXJGljsSokaNaV14gZ/dazOcADVQr2+0DMzXCDvHQwDPG9oG9sf5EXCJoMu5yIEfKVw==',key_name='tempest-keypair-1714568544',keypairs=<?>,launch_index=0,launched_at=2023-04-14T19:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebb0956418bd462c84e1392a74b5ae2e',ramdisk_id='',reservation_id='r-594lfxgw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='09ac11b8-b53a-4bc5-8785-aad1f28737d3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1405261713',owner_user_name='tempest-AttachVolumeShelveTestJSON-1405261713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T19:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='716e5499c6eb483e9c88fd25606018d9',uuid=00ddbcca-fe9f-4417-8b6f-96671e666aed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converting VIF {"id": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "address": "fa:16:3e:d0:ca:f7", "network": {"id": "398116e9-945d-474d-918d-f2f5ac726032", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1308346547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebb0956418bd462c84e1392a74b5ae2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ee81da0-d1", "ovs_interfaceid": "9ee81da0-d1c9-443e-b4ea-73648dd076fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG nova.network.os_vif_util [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG os_vif [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1') {{(pid=71308) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ee81da0-d1, bridge=br-int, if_exists=True) {{(pid=71308) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:16:30 user nova-compute[71308]: INFO os_vif [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:ca:f7,bridge_name='br-int',has_traffic_filtering=True,id=9ee81da0-d1c9-443e-b4ea-73648dd076fa,network=Network(398116e9-945d-474d-918d-f2f5ac726032),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ee81da0-d1')
Apr 14 19:16:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Deleting instance files /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed_del
Apr 14 19:16:30 user nova-compute[71308]: INFO nova.virt.libvirt.driver [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Deletion of /opt/stack/data/nova/instances/00ddbcca-fe9f-4417-8b6f-96671e666aed_del complete
Apr 14 19:16:30 user nova-compute[71308]: INFO nova.compute.manager [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 19:16:30 user nova-compute[71308]: DEBUG oslo.service.loopingcall [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71308) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG nova.compute.manager [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Deallocating network for instance {{(pid=71308) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] deallocate_for_instance() {{(pid=71308) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG nova.network.neutron [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Updating instance_info_cache with network_info: [] {{(pid=71308) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 19:16:30 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Took 0.77 seconds to deallocate network for instance.
Apr 14 19:16:30 user nova-compute[71308]: DEBUG nova.compute.manager [req-adfa35b3-aa4a-4ae7-b9e9-ee88feccb1cc req-163bebbe-98c6-41ff-beeb-4b2ee3b49bf7 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-deleted-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:16:30 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.104s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:16:31 user nova-compute[71308]: INFO nova.scheduler.client.report [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Deleted allocations for instance 00ddbcca-fe9f-4417-8b6f-96671e666aed
Apr 14 19:16:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-913f9015-f66b-4b25-af55-c89022dfed40 tempest-AttachVolumeShelveTestJSON-1405261713 tempest-AttachVolumeShelveTestJSON-1405261713-project-member] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.942s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] Acquiring lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] Lock "00ddbcca-fe9f-4417-8b6f-96671e666aed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:16:31 user nova-compute[71308]: DEBUG nova.compute.manager [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] No waiting events found dispatching network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa {{(pid=71308) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 19:16:31 user nova-compute[71308]: WARNING nova.compute.manager [req-f69fcbc2-c1b9-456f-b2dc-54477e94c1a3 req-4289a075-37bd-4404-b565-e9f646f6e431 service nova] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Received unexpected event network-vif-plugged-9ee81da0-d1c9-443e-b4ea-73648dd076fa for instance with vm_state deleted and task_state None.
Apr 14 19:16:32 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:16:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 19:16:32 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 19:16:34 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:39 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:40 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:16:45 user nova-compute[71308]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681499790.0490646, 00ddbcca-fe9f-4417-8b6f-96671e666aed => Stopped> {{(pid=71308) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 19:16:45 user nova-compute[71308]: INFO nova.compute.manager [-] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] VM Stopped (Lifecycle Event)
Apr 14 19:16:45 user nova-compute[71308]: DEBUG nova.compute.manager [None req-d90a7a1d-f335-49dc-a0ec-87fd9e19a557 None None] [instance: 00ddbcca-fe9f-4417-8b6f-96671e666aed] Checking state {{(pid=71308) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 19:16:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:16:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71308) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 19:16:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:16:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71308) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 19:16:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:16:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:17:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:17:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:17:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:17:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:17:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:17:22 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:24 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:17:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:17:24 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:17:24 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:17:25 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:17:25 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=26.257110595703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing inventories for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating ProviderTree inventory for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Updating inventory in ProviderTree for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing aggregate associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, aggregates: None {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Refreshing trait associations for resource provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE41,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA {{(pid=71308) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:17:25 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:17:26 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:29 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:29 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:17:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:17:30 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:30 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:31 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:17:32 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:33 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:17:34 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:17:34 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 19:17:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 19:17:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:17:37 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:37 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 19:17:38 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] There are 0 instances to clean {{(pid=71308) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 19:17:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:17:43 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:17:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:17:53 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:17:53 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71308) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 19:17:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:18:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:18:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:18:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:18:15 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:18:17 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:20 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:18:23 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:25 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:18:25 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:26 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Auditing locally available compute resources for user (node: user) {{(pid=71308) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 19:18:27 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:18:27 user nova-compute[71308]: WARNING nova.virt.libvirt.driver [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 19:18:27 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=26.246685028076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71308) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71308) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG nova.compute.provider_tree [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed in ProviderTree for provider: 6bfcc2ea-9653-419f-9d55-6c72edc19d11 {{(pid=71308) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG nova.scheduler.client.report [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Inventory has not changed for provider 6bfcc2ea-9653-419f-9d55-6c72edc19d11 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71308) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG nova.compute.resource_tracker [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Compute_service record updated for user:user {{(pid=71308) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 19:18:27 user nova-compute[71308]: DEBUG oslo_concurrency.lockutils [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=71308) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 19:18:30 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:18:31 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:31 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:31 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71308) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 19:18:31 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:33 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:35 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:18:35 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Starting heal instance info cache {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 19:18:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Rebuilding the list of instances to heal {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 19:18:35 user nova-compute[71308]: DEBUG nova.compute.manager [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Didn't find any instances for network info cache update. {{(pid=71308) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 19:18:40 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:18:41 user nova-compute[71308]: DEBUG oslo_service.periodic_task [None req-8ee27da7-e85e-458c-91f7-7af7a9675b53 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71308) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 19:18:45 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:18:50 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:18:52 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:18:55 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:19:00 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 19:19:05 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 19:19:10 user nova-compute[71308]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71308) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}